00000001:02000400:0.0F:1790100217.240224:0:3299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1790100230.126066:0:3519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1790100231.202786:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 831 MB/s 00000001:01000000:2.0:1790100231.452534:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1175 MB/s 00000001:01000000:1.0F:1790100231.702418:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8003 MB/s 00000020:02000000:2.0:1790100232.211574:0:3610:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_63_g8caac7f 00000400:02000000:1.0:1790100232.823587:0:3625:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.113@tcp [8/256/0/180] 00008000:02000000:1.0:1790100235.840144:0:3775:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1790100275.331873:0:5740:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790100284.126240:0:6490:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790100284.126246:0:6490:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1790100284.126248:0:6490:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790100284.126422:0:6490:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001b7839f6 00000080:02000400:2.0:1790100284.126432:0:6490:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1790100284.131157:0:6490:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1790100284.131168:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790100284.131194:0:6490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e3efb4b1) 00000020:00000080:2.0:1790100284.131211:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790100284.181009:0:6490:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790100284.181088:0:6490:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1790100284.204038:0:6490:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790100284.205110:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790100284.205120:0:6490:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790100284.205204:0:6490:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298286647 00000020:01000004:3.0:1790100284.205211:0:6490:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1790100284.205216:0:6490:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790100284.205231:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001b7839f6 from MGS 00000020:01000004:3.0:1790100284.205235:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790100284.205258:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006b5d4c50) 00000020:00000080:3.0:1790100284.205275:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790100284.205396:0:6490:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001b7839f6 from MGS, refs=2 00080000:01000000:3.0:1790100284.205403:0:6490:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790100284.205408:0:6490:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298286655 00000100:00100000:3.0:1790100284.205589:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790100284.206284:0:6490:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790100284.206290:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790100284.210525:0:6490:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790100284.210539:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790100284.211688:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100284.211873:0:6490:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790100284.211879:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790100284.220802:0:6490:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790100284.220839:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790100284.223512:0:6490:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790100284.223529:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790100284.224529:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100284.224533:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100284.224535:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100284.230281:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100284.230288:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100284.230291:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100284.237418:0:6490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790100284.240378:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1790100284.487443:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4019 MB/s 00000001:01000000:0.0:1790100284.737829:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4775 MB/s 00000001:01000000:2.0:1790100284.987803:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 679 MB/s 00000001:01000000:2.0:1790100285.238467:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1099 MB/s 00080000:10000000:3.0:1790100285.245724:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1790100285.256583:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790100285.261763:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1790100285.263590:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790100285.264834:0:6490:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790100285.264881:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790100285.265074:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790100285.265096:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790100285.265641:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100285.265790:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790100285.265795:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790100285.266629:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790100285.266637:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790100285.267766:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790100285.267776:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790100285.268478:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790100285.268502:0:6490:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:3.0:1790100285.268504:0:6490:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790100285.268592:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:3.0:1790100285.268603:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (000000000d3372a7) 00000020:00000080:3.0:1790100285.268619:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790100285.268743:0:6490:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cc60a189@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1790100285.268975:0:6490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:3.0:1790100285.268982:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 10000000:01000000:3.0:1790100285.269311:0:6510:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790100285.269366:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 2a237a43-d248-40fc-b145-fd7f23146511) 00000020:00000080:3.0:1790100285.269381:0:6490:0:(genops.c:1384:class_connect()) connect: client 2a237a43-d248-40fc-b145-fd7f23146511, cookie 0xc87a4f2298286663 00000100:00080000:3.0:1790100285.269391:0:6490:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790100285.269399:0:6490:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import 00000000cc60a189 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100285.269437:0:6490:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d150659f x1877056140869760/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790100285.269457:0:6490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2a237a43-d248-40fc-b145-fd7f23146511->MGS 00000020:01000004:3.0:1790100285.269472:0:6490:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790100285.269476:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790100285.269484:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000087c87e6c) 00000020:00000080:3.0:1790100285.269501:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1790100285.270002:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1790100285.271980:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d150659f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a237a43-d248-40fc-b145-fd7f23146511:3640:1877056140869760:0@lo:250: 00000100:00100000:0.0:1790100285.272067:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100285.272140:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140869760 00000100:00100000:0.0:1790100285.272149:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140869760 00000100:00100000:0.0:1790100285.272185:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100285.272191:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003288d5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1877056140869760:12345-0@lo:250: 00010000:00080000:0.0:1790100285.272226:0:6505:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2a237a43-d248-40fc-b145-fd7f23146511@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:0.0:1790100285.272249:0:6505:0:(genops.c:1384:class_connect()) connect: client 2a237a43-d248-40fc-b145-fd7f23146511, cookie 0xc87a4f2298286671 00000100:00080000:0.0:1790100285.272382:0:6505:0:(import.c:65:import_set_state_nolock()) 00000000bd62c0f0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100285.272427:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003288d5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+5:3640:x1877056140869760:12345-0@lo:250: Request processed in 235us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100285.272434:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100285.272478:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790100285.272486:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:0.0:1790100285.272492:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790100285.272502:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790100285.272505:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000cc60a189 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790100285.272508:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790100285.272511:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790100285.272515:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d150659f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a237a43-d248-40fc-b145-fd7f23146511:3640:1877056140869760:0@lo:250: 00000100:00100000:3.0:1790100285.285166:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100285.285534:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790100285.285541:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790100285.287960:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790100285.287970:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790100285.289789:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790100285.289799:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790100285.291779:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100285.291967:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790100285.291978:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790100285.292598:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790100285.292605:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790100285.317809:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100285.318005:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790100285.318012:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790100285.319095:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790100285.319105:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790100285.319861:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100285.320011:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790100285.320023:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790100285.320844:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790100285.320853:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790100285.321658:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100285.321820:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790100285.321825:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790100285.322266:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790100285.322273:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790100285.323236:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100285.323667:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790100285.323673:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790100285.324117:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790100285.324124:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790100285.340235:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100285.340650:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790100285.340657:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790100285.341926:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790100285.341938:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790100285.342740:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790100285.342748:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790100285.343616:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790100285.343640:0:6490:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1790100285.343644:0:6490:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790100285.343721:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790100285.343749:0:6490:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790100285.343753:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790100285.343755:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790100285.343756:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100285.343758:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100285.343759:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100285.343760:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100285.343761:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100285.343762:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100285.343763:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790100285.343765:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790100285.343766:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100285.343767:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790100285.343769:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790100285.343771:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790100285.343772:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790100285.343773:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100285.343773:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100285.343774:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100285.343775:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100285.343776:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100285.343777:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100285.343778:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790100285.343779:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790100285.343780:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100285.343780:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790100285.343809:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790100285.343826:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140869888:0@lo:253: 00000100:00100000:3.0:1790100285.343892:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100285.343939:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000217a842e going to sleep for 11 seconds 00000100:00100000:0.0:1790100285.343983:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140869888 00000100:00100000:0.0:1790100285.343989:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140869888 00000100:00100000:0.0:1790100285.344020:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100285.344025:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ba24a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+5:6490:x1877056140869888:12345-0@lo:253: 20000000:01000000:0.0:1790100285.344067:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790100285.344070:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1790100285.344555:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790100285.344597:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1790100285.344962:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100285.345988:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790100285.346243:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790100285.346248:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790100285.346252:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790100285.346255:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790100285.346558:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790100285.346770:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100285.347001:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790100285.347014:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790100285.347032:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790100285.347051:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790100285.347080:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790100285.347135:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790100285.347143:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790100285.347156:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790100285.347162:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790100285.347173:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790100285.347177:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790100285.347187:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790100285.347201:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790100285.347240:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790100285.347245:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790100285.347253:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100285.347946:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1790100285.347959:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790100285.347975:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1790100285.347992:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1790100285.348007:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1790100285.348016:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1790100285.348045:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1790100285.348052:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790100285.348065:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1790100285.348079:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1790100285.348094:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1790100285.348102:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1790100285.348126:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1790100285.348134:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1790100285.348147:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1790100285.348162:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1790100285.348226:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1790100285.348247:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1790100285.348254:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1790100285.348966:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1790100285.349125:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1790100285.349145:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:3.0:1790100285.349147:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1790100285.349161:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1790100285.349168:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790100285.349180:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1790100285.349185:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1790100285.349198:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1790100285.349205:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1790100285.349229:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1790100285.349686:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1790100285.349722:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790100285.349725:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790100285.349728:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790100285.349767:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790100285.349769:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790100285.350031:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1790100285.350173:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1790100285.350190:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1790100285.350205:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1790100285.350225:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790100285.350227:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790100285.350678:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1790100285.350881:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1790100285.350902:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1790100285.350916:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1790100285.350926:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790100285.350928:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1790100285.350932:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790100285.350934:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790100285.350946:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1790100285.350952:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1790100285.354123:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1790100285.354295:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1790100285.363003:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1790100285.363041:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1790100285.363058:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1790100285.363078:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790100285.363097:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363113:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363122:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363128:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363134:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363140:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363146:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000025784de1 already unused, calling callback (00000000d6f996eb) 00010000:00010000:3.0:1790100285.363150:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363169:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363197:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363205:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.363223:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000025784de1/0xc87a4f2298286678 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790100285.363243:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790100285.379705:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ba24a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+5:6490:x1877056140869888:12345-0@lo:253: Request processed in 35671us (35806us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.379726:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100285.380009:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140869888:0@lo:253: 10000000:01000000:3.0:1790100285.380023:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790100285.380026:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100285.380028:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790100285.380029:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100285.380030:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1790100285.380032:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100285.380033:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100285.380034:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100285.380035:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100285.380036:0:6490:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790100285.380038:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100285.380039:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790100285.380056:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001b7839f6 from lustre-MDT0000 10000000:01000000:3.0:1790100285.380084:0:6490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790100285.380087:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790100285.380091:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9261b2304d40 10000000:01000000:3.0:1790100285.380095:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790100285.380103:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9261b2304d40 from 1 10000000:01000000:3.0:1790100285.380106:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790100285.380263:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.380286:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.380296:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100285.380313:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870016:0@lo:101: 00000100:00100000:3.0:1790100285.380386:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100285.380497:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140870016 00000100:00100000:0.0:1790100285.380505:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140870016 00000100:00100000:3.0:1790100285.380530:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a2beb5b going to sleep for 11 seconds 00000100:00100000:0.0:1790100285.380549:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100285.380557:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c520a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+5:6490:x1877056140870016:12345-0@lo:101: 00010000:00010000:0.0:1790100285.380575:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100285.380587:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828667f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.380606:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828667f expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.380614:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828667f expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.380621:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a706e5b9, rc 0) 00000100:00100000:0.0:1790100285.380660:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c520a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+6:6490:x1877056140870016:12345-0@lo:101: Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100285.380665:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100285.381060:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870016:0@lo:101: 00010000:00010000:3.0:1790100285.381073:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.381081:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100285.381143:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870144:0@lo:501: 00000100:00100000:3.0:1790100285.381183:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100285.381207:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a2beb5b going to sleep for 11 seconds 00000100:00100000:1.0:1790100285.383228:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140870144 00000100:00100000:1.0:1790100285.383253:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140870144 00000100:00100000:1.0:1790100285.383319:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100285.383327:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080fe119a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+6:6490:x1877056140870144:12345-0@lo:501: 00000100:00100000:1.0:1790100285.383508:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080fe119a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+6:6490:x1877056140870144:12345-0@lo:501: Request processed in 181us (2324us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100285.383517:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100285.383557:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870144:0@lo:501: 10000000:01000000:3.0:1790100285.383594:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790100285.383619:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.383628:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100285.383648:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff926187007800 10000000:01000000:3.0:1790100285.383653:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790100285.383657:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff926187007800 10000000:01000000:3.0:1790100285.383659:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790100285.383662:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff926187007800 from 1 10000000:01000000:3.0:1790100285.383664:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790100285.383691:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f715bf58/0xc87a4f229828668d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.383697:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000f715bf58/0xc87a4f229828668d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.383704:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000f715bf58/0xc87a4f229828668d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100285.383717:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870272:0@lo:101: 00000100:00100000:3.0:1790100285.383746:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100285.383786:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a2beb5b going to sleep for 11 seconds 00000100:00100000:0.0:1790100285.383908:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140870272 00000100:00100000:0.0:1790100285.383913:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140870272 00000100:00100000:0.0:1790100285.383946:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100285.383952:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069e0ff58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+6:6490:x1877056140870272:12345-0@lo:101: 00010000:00010000:0.0:1790100285.383961:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100285.383970:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001bce740/0xc87a4f2298286694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828668d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.383988:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001bce740/0xc87a4f2298286694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828668d expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.383996:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001bce740/0xc87a4f2298286694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828668d expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.384004:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001bce740, rc 0) 00000100:00100000:0.0:1790100285.384046:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069e0ff58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+7:6490:x1877056140870272:12345-0@lo:101: Request processed in 93us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100285.384052:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100285.384133:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870272:0@lo:101: 00010000:00010000:1.0:1790100285.384143:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000f715bf58/0xc87a4f229828668d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.384207:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000f715bf58/0xc87a4f229828668d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100285.384228:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790100285.384240:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f715bf58/0xc87a4f229828668d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.384246:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000f715bf58/0xc87a4f229828668d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100285.384252:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790100285.384255:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100285.384258:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff926187007800 10000000:01000000:1.0:1790100285.384260:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790100285.384263:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790100285.384264:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790100285.384292:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.384307:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.384313:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100285.384325:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870400:0@lo:101: 00000100:00100000:1.0:1790100285.384372:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.384485:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a71fea7b going to sleep for 11 seconds 00000100:00100000:3.0:1790100285.387272:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140870400 00000100:00100000:3.0:1790100285.387288:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140870400 00000100:00100000:3.0:1790100285.387382:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100285.387446:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f066dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+7:6490:x1877056140870400:12345-0@lo:101: 00010000:00010000:3.0:1790100285.387464:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100285.387480:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828669b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.387505:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828669b expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.387530:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828669b expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.387539:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000110dbe98, rc 0) 00000100:00100000:3.0:1790100285.387613:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f066dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+8:6490:x1877056140870400:12345-0@lo:101: Request processed in 224us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100285.387620:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100285.387994:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870400:0@lo:101: 00010000:00010000:1.0:1790100285.388011:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.388021:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100285.388089:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870528:0@lo:501: 00000100:00100000:1.0:1790100285.388135:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.388180:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a71fea7b going to sleep for 11 seconds 00000100:00100000:0.0:1790100285.388370:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140870528 00000100:00100000:0.0:1790100285.388376:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140870528 00000100:00100000:0.0:1790100285.388407:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100285.388414:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fffc9789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+8:6490:x1877056140870528:12345-0@lo:501: 00000100:00100000:0.0:1790100285.388526:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fffc9789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+9:6490:x1877056140870528:12345-0@lo:501: Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100285.388534:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100285.388690:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870528:0@lo:501: 00000100:00100000:1.0:1790100285.388717:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870656:0@lo:503: 00000100:00100000:1.0:1790100285.388757:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.388788:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a71fea7b going to sleep for 11 seconds 00000100:00100000:3.0:1790100285.388990:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140870656 00000100:00100000:3.0:1790100285.388995:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140870656 00000100:00100000:3.0:1790100285.389064:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100285.389071:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b674cfe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+9:6490:x1877056140870656:12345-0@lo:503: 00000100:00100000:3.0:1790100285.389284:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b674cfe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+9:6490:x1877056140870656:12345-0@lo:503: Request processed in 213us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100285.389291:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100285.389374:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140870656:0@lo:503: 00000100:00100000:1.0:1790100285.393039:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:6534:1877056140870784:0@lo:502: 00000100:00100000:1.0:1790100285.393127:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.393187:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c235270 going to sleep for 11 seconds 00000100:00100000:2.0:1790100285.393404:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140870784 00000100:00100000:2.0:1790100285.393412:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140870784 00000100:00100000:2.0:1790100285.393457:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100285.393466:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016e1a3d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+9:6534:x1877056140870784:12345-0@lo:502: 00000100:00100000:2.0:1790100285.393587:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016e1a3d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+9:6534:x1877056140870784:12345-0@lo:502: Request processed in 123us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100285.393595:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100285.393722:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:6534:1877056140870784:0@lo:502: 00000020:01000000:1.0:1790100285.393750:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100285.393761:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100285.393763:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790100285.393768:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790100285.393771:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100285.393790:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ce72ef1b) 00000020:00000080:1.0:1790100285.393806:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790100285.393813:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790100285.393938:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790100285.393946:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f22982866b0 00000020:00000080:1.0:1790100285.394372:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790100285.394377:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100285.394381:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100285.394383:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790100285.394386:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100285.394389:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100285.394390:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790100285.394393:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100285.394399:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008cb219af) 00000020:00000080:1.0:1790100285.394410:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790100285.394413:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790100285.394414:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790100285.394417:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790100285.394422:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790100285.394472:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001b7839f6 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790100285.394485:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000091de0ca6) 00000020:00000080:1.0:1790100285.394493:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790100285.394554:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790100285.394566:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f22982866c5 00000020:00000080:1.0:1790100285.394668:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790100285.394674:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790100285.394678:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc87a4f22982866cc 00080000:01000000:1.0:1790100285.394683:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790100285.394687:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f22982866d3 00080000:10000000:1.0:1790100285.395317:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1790100285.395565:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1790100285.403265:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1790100285.474067:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1790100285.474622:0:6534:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1790100285.477618:0:6534:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1790100285.478301:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790100285.481002:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000070315d0d) 00000020:00000080:2.0:1790100285.481023:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790100285.481282:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790100285.481290:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f22982866e1 00000020:00000080:3.0:1790100285.481770:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1790100285.483613:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1790100285.488500:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1790100285.491073:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1790100285.496759:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1790100285.502855:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1790100285.504901:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1790100285.506494:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc87a4f22982866e8 00000020:00000080:0.0:1790100285.506813:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790100285.506824:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100285.506830:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100285.506832:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790100285.506835:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100285.506838:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100285.506840:0:6534:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790100285.506842:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790100285.506844:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790100285.506846:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100285.506848:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100285.506850:0:6534:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790100285.506859:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100285.506864:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100285.506865:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790100285.506868:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790100285.506902:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1790100285.506963:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8b39f65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:6534:1877056140870912:0@lo:502: 00000100:00100000:0.0:1790100285.507032:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100285.507121:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6178695 going to sleep for 11 seconds 00000100:00100000:1.0:1790100285.507246:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140870912 00000100:00100000:1.0:1790100285.507254:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140870912 00000100:00100000:1.0:1790100285.507329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100285.507371:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064f8bf63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+9:6534:x1877056140870912:12345-0@lo:502: 00000100:00100000:1.0:1790100285.507483:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064f8bf63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+9:6534:x1877056140870912:12345-0@lo:502: Request processed in 146us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.507491:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100285.507579:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8b39f65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:6534:1877056140870912:0@lo:502: 00000020:01000000:3.0:1790100285.507605:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100285.507609:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100285.507611:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1790100285.507615:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1790100285.507774:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1790100285.507793:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790100285.507807:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.507817:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100285.507832:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926187007800 from 1 10000000:01000000:2.0:1790100285.507835:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790100285.507866:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.507874:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.507882:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100285.507895:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871040:0@lo:101: 00000100:00100000:2.0:1790100285.507924:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100285.508060:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c95c963 going to sleep for 11 seconds 00000100:00100000:0.0:1790100285.508127:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140871040 00000100:00100000:0.0:1790100285.508132:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140871040 00000100:00100000:0.0:1790100285.508164:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100285.508170:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ef647663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+9:6490:x1877056140871040:12345-0@lo:101: 00010000:00010000:0.0:1790100285.508179:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100285.508189:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982866ef expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.508219:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982866ef expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.508230:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982866ef expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.508237:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0ea056c, rc 0) 00000100:00100000:0.0:1790100285.508273:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ef647663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+10:6490:x1877056140871040:12345-0@lo:101: Request processed in 103us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100285.508279:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100285.508417:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871040:0@lo:101: 00010000:00010000:2.0:1790100285.508430:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.508439:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100285.508951:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871168:0@lo:256: 00000100:00100000:2.0:1790100285.508987:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100285.509011:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c95c963 going to sleep for 11 seconds 00000100:00100000:0.0:1790100285.509090:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140871168 00000100:00100000:0.0:1790100285.509095:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140871168 00000100:00100000:0.0:1790100285.509115:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100285.509121:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000913eb8fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+10:6490:x1877056140871168:12345-0@lo:256: 20000000:01000000:0.0:1790100285.509140:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790100285.509155:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790100285.509222:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000913eb8fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+10:6490:x1877056140871168:12345-0@lo:256: Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100285.509229:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790100285.509396:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871168:0@lo:256: 10000000:01000000:2.0:1790100285.509921:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790100285.509936:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.510594:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100285.510603:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926187007800 from 1 10000000:01000000:2.0:1790100285.510606:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790100285.510635:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.510641:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.510648:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100285.510664:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871296:0@lo:101: 00000100:00100000:2.0:1790100285.510709:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100285.510739:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c95c963 going to sleep for 11 seconds 00000100:00100000:0.0:1790100285.510848:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140871296 00000100:00100000:0.0:1790100285.510855:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140871296 00000100:00100000:0.0:1790100285.510886:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790100285.510892:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007452d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+10:6490:x1877056140871296:12345-0@lo:101: 00010000:00010000:0.0:1790100285.510904:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100285.510915:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982866fd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.510934:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982866fd expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.510943:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982866fd expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.510950:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007487ac98, rc 0) 00000100:00100000:0.0:1790100285.510980:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007452d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+11:6490:x1877056140871296:12345-0@lo:101: Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100285.510987:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100285.511130:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871296:0@lo:101: 00010000:00010000:2.0:1790100285.511191:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.511200:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100285.511264:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871424:0@lo:501: 00000100:00100000:2.0:1790100285.511289:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100285.511409:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c95c963 going to sleep for 11 seconds 00000100:00100000:1.0:1790100285.511573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140871424 00000100:00100000:1.0:1790100285.511578:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140871424 00000100:00100000:1.0:1790100285.511603:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100285.511609:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094fb15a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+11:6490:x1877056140871424:12345-0@lo:501: 00000100:00100000:1.0:1790100285.511768:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094fb15a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+11:6490:x1877056140871424:12345-0@lo:501: Request processed in 158us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.511775:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100285.511876:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871424:0@lo:501: 00000100:00100000:2.0:1790100285.511902:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871552:0@lo:503: 00000100:00100000:2.0:1790100285.511938:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100285.511964:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c95c963 going to sleep for 11 seconds 00000100:00100000:1.0:1790100285.512005:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140871552 00000100:00100000:1.0:1790100285.512009:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140871552 00000100:00100000:1.0:1790100285.512027:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790100285.512032:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c100181 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+11:6490:x1877056140871552:12345-0@lo:503: 00000040:00080000:1.0:1790100285.512066:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100285.512112:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c100181 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+11:6490:x1877056140871552:12345-0@lo:503: Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.512119:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100285.512195:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871552:0@lo:503: 00000040:00080000:1.0:1790100285.513031:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1790100285.513091:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1790100285.513110:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100285.513122:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.513130:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100285.513180:0:6490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790100285.513183:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff926187007800 10000000:01000000:1.0:1790100285.513186:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff926187007800 10000000:01000000:1.0:1790100285.513190:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100285.513195:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926187007800 from 1 10000000:01000000:1.0:1790100285.513197:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100285.513232:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.513239:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.513248:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100285.513262:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871680:0@lo:101: 00000100:00100000:1.0:1790100285.513297:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.513323:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf059857 going to sleep for 11 seconds 00000100:00100000:1.0:1790100285.513360:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140871680 00000100:00100000:1.0:1790100285.513365:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140871680 00000100:00100000:1.0:1790100285.513388:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100285.513395:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e42d7dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+11:6490:x1877056140871680:12345-0@lo:101: 00010000:00010000:1.0:1790100285.513403:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100285.513415:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828670b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.513433:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828670b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.513442:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828670b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.513450:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000236ae7cd, rc 0) 00000100:00100000:1.0:1790100285.513480:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e42d7dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6490:x1877056140871680:12345-0@lo:101: Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.513486:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100285.513521:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871680:0@lo:101: 00010000:00010000:1.0:1790100285.513531:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.513539:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100285.513579:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871808:0@lo:501: 00000100:00100000:1.0:1790100285.513602:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.513615:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf059857 going to sleep for 11 seconds 00000100:00100000:1.0:1790100285.513633:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140871808 00000100:00100000:1.0:1790100285.513637:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140871808 00000100:00100000:1.0:1790100285.513654:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100285.513658:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020112750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6490:x1877056140871808:12345-0@lo:501: 00000100:00100000:1.0:1790100285.513746:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020112750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6490:x1877056140871808:12345-0@lo:501: Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.513753:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100285.513782:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871808:0@lo:501: 00000100:00100000:1.0:1790100285.513805:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871936:0@lo:503: 00000100:00100000:1.0:1790100285.513839:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.513852:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf059857 going to sleep for 11 seconds 00000100:00100000:1.0:1790100285.513864:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140871936 00000100:00100000:1.0:1790100285.513868:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140871936 00000100:00100000:1.0:1790100285.513883:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100285.513888:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074c51a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6490:x1877056140871936:12345-0@lo:503: 00000100:00100000:1.0:1790100285.513956:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074c51a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6490:x1877056140871936:12345-0@lo:503: Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.513962:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100285.513999:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140871936:0@lo:503: 00000100:00100000:1.0:1790100285.515324:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:6539:1877056140872064:0@lo:502: 00000100:00100000:1.0:1790100285.515592:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.515660:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d6ef4ca going to sleep for 11 seconds 00000100:00100000:2.0:1790100285.515696:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140872064 00000100:00100000:2.0:1790100285.515702:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140872064 00000100:00100000:2.0:1790100285.515769:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100285.515777:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015d7a397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6539:x1877056140872064:12345-0@lo:502: 00000100:00100000:2.0:1790100285.515879:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015d7a397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6539:x1877056140872064:12345-0@lo:502: Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100285.515886:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790100285.515953:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:6539:1877056140872064:0@lo:502: 00000020:01000004:1.0:1790100285.516006:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790100285.516019:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000cb9168fb) 00000020:00000080:1.0:1790100285.516035:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1790100285.516124:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001b7839f6 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790100285.516128:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001b7839f6 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790100285.516130:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001b7839f6 4 00010000:00080000:1.0:1790100285.516169:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c9e3f6f3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790100285.517799:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1790100285.517999:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790100285.518032:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790100285.518043:0:6539:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc87a4f2298286720 00000100:00080000:1.0:1790100285.518052:0:6539:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790100285.518060:0:6539:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c9e3f6f3 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100285.518098:0:6539:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000075a7265f x1877056140872192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100285.518118:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790100285.518281:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b48db793 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:6539:1877056140872320:0@lo:502: 00000100:00100000:1.0:1790100285.518370:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100285.518525:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056140872192:0@lo:38: 00000100:00100000:0.0:1790100285.518560:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100285.518631:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140872192 00000100:00100000:0.0:1790100285.518638:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140872192 00000100:00100000:0.0:1790100285.518667:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100285.518673:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000046a26d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1877056140872192:12345-0@lo:38: 00000100:00100000:0.0:1790100285.518724:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000046a26d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1877056140872192:12345-0@lo:38: Request processed in 50us (164us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790100285.518730:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100285.518760:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100285.518767:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000c9e3f6f3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100285.518770:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790100285.518773:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a7265f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056140872192:0@lo:38: 00000100:00100000:1.0:1790100285.524452:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f39e9f3 going to sleep for 11 seconds 00000100:00100000:3.0:1790100285.524621:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140872320 00000100:00100000:3.0:1790100285.524630:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140872320 00000100:00100000:3.0:1790100285.524676:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790100285.524684:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e5cc2fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+12:6539:x1877056140872320:12345-0@lo:502: 00000100:00100000:3.0:1790100285.524832:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e5cc2fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+12:6539:x1877056140872320:12345-0@lo:502: Request processed in 149us (6462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100285.524846:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790100285.524934:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b48db793 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:6539:1877056140872320:0@lo:502: 00000040:00080000:1.0:1790100285.524968:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1790100285.525101:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1790100285.525123:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790100285.525143:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.525253:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790100285.525296:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790100285.525298:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790100285.525300:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100285.525301:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100285.525302:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100285.525303:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100285.525304:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100285.525305:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100285.525306:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790100285.525307:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790100285.525309:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100285.525310:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790100285.525313:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1790100285.525315:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790100285.525316:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790100285.525317:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100285.525318:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100285.525319:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100285.525320:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100285.525321:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100285.525322:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100285.525323:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790100285.525324:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790100285.525325:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100285.525326:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790100285.525436:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790100285.525449:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f041fbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140872448:0@lo:253: 00000100:00100000:3.0:1790100285.525493:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100285.525580:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fbfb99c going to sleep for 11 seconds 00000100:00100000:2.0:1790100285.525666:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140872448 00000100:00100000:2.0:1790100285.525672:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140872448 00000100:00100000:2.0:1790100285.525699:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100285.525705:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cde57882 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6490:x1877056140872448:12345-0@lo:253: 20000000:01000000:2.0:1790100285.525726:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790100285.525738:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790100285.531776:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790100285.531832:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790100285.532547:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cde57882 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6490:x1877056140872448:12345-0@lo:253: Request processed in 6838us (7051us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100285.532560:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:0.0:1790100285.532600:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790100285.532605:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790100285.532622:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.532637:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982866ef expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.532644:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.532677:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982866ef expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.532690:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982866ef expref: 11 pid: 6506 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100285.532702:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ab50c5f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140872576:0@lo:104: 00000100:00100000:0.0:1790100285.532736:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100285.532831:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b9596fd going to sleep for 11 seconds 00000100:00100000:1.0:1790100285.534459:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140872576 00000100:00100000:1.0:1790100285.534470:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140872576 00000100:00100000:1.0:1790100285.534514:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100285.534520:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf408209 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:6528:x1877056140872576:12345-0@lo:104: 00010000:00010000:1.0:1790100285.534532:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.534602:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100285.534606:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf408209 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:6528:x1877056140872576:12345-0@lo:104: Request processed in 87us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.534624:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100285.534728:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ab50c5f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140872576:0@lo:104: 00010000:00010000:0.0:1790100285.534751:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.534814:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100285.534819:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.534827:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000c37c330 already unused, calling callback (00000000826b2a0f) 10000000:00010000:2.0:1790100285.534835:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.534854:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100285.534860:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100285.534866:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100285.534898:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.534905:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100285.534932:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.534938:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 000000000c37c330/0xc87a4f22982866ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982866f6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.534953:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100285.534954:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100285.534956:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100285.535064:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140872704:0@lo:103: 00000100:00100000:0.0:1790100285.535118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100285.535243:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f041fbe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:6490:1877056140872448:0@lo:253: 10000000:01000000:3.0:1790100285.535256:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:2.0:1790100285.535256:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140872704 00000020:01000004:3.0:1790100285.535260:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100285.535263:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:2.0:1790100285.535263:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140872704 00000020:01000004:3.0:1790100285.535267:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100285.535269:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100285.535271:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100285.535272:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100285.535274:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100285.535275:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100285.535276:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790100285.535277:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790100285.535279:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100285.535280:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1790100285.535286:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982866ef expref: 12 pid: 6506 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1790100285.535290:0:6490:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1790100285.535322:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100285.535333:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ab50c5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+12:3642:x1877056140872704:12345-0@lo:103: 00010000:00010000:2.0:1790100285.535363:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100285.535379:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982866ef expref: 12 pid: 6506 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535390:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982866ef expref: 12 pid: 6506 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535402:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0ea056c/0xc87a4f22982866f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982866ef expref: 12 pid: 6506 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535415:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535428:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790100285.535444:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002838767s 00010000:00010000:2.0:1790100285.535447:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535453:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535458:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535467:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535472:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dabfad21 already unused, calling callback (00000000d6f996eb) 00010000:00010000:2.0:1790100285.535475:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535481:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535510:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.535521:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100285.535550:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ab50c5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+11:3642:x1877056140872704:12345-0@lo:103: Request processed in 218us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100285.535557:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790100285.535606:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.535614:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.535620:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dabfad21/0xc87a4f2298286727 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100285.535682:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f777940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140872704:0@lo:103: 00080000:10000000:3.0:1790100285.541250:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1790100285.541463:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1790100285.541947:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1790100285.542152:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1790100285.542385:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1790100285.542538:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1790100285.546916:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1790100285.547096:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1790100285.548332:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1790100285.548525:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1790100285.548729:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1790100285.549978:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1790100285.553087:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790100285.562117:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790100285.562201:0:6544:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1790100285.562205:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790100285.562382:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790100285.564712:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790100285.565847:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790100285.566296:0:6490:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790100285.566307:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790100285.566635:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100285.567708:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790100285.568898:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:1.0:1790100285.568945:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1790100285.568949:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790100285.569111:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790100285.569310:0:6490:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1790100285.571606:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790100285.571767:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790100285.572607:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790100285.572766:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790100285.572985:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790100285.573119:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790100285.573282:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790100285.573442:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790100285.573583:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790100285.573748:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790100285.573902:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790100285.574050:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790100285.574185:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790100285.574334:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790100285.574545:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790100285.574688:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790100285.574987:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790100285.575147:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000040:00080000:1.0:1790100285.577484:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790100285.577565:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790100285.577570:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1790100285.578720:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790100285.580242:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790100285.580880:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790100285.582024:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790100285.582187:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790100285.582464:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790100285.582605:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790100285.582777:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790100285.582918:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790100285.583050:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790100285.583204:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790100285.583410:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790100285.583553:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790100285.583650:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790100285.583798:0:6490:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1790100285.601351:0:6490:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790100285.601393:0:6490:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbae481ccf988 00100000:10000000:0.0:1790100285.601401:0:6490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790100285.603552:0:6490:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790100285.603567:0:6490:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790100285.603586:0:6490:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790100285.603625:0:6490:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1790100285.604601:0:6490:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790100285.604828:0:6490:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1790100286.280533:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100287.304462:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100288.162634:0:6789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790100288.330419:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790100288.745162:0:6841:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790100288.745547:0:6841:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790100289.352684:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100290.376469:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790100290.505392:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790100290.505400:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926187007800 from 3 10000000:01000000:1.0:1790100290.505404:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100290.505442:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.505468:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.505478:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100290.505497:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b48db793 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140872832:0@lo:101: 00000100:00100000:1.0:1790100290.505556:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100290.505614:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000006d06818c going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.505713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140872832 00000100:00100000:0.0:1790100290.505721:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140872832 00000100:00100000:0.0:1790100290.505766:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790100290.505775:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091c89d3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+11:6510:x1877056140872832:12345-0@lo:101: 00010000:00010000:0.0:1790100290.505786:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100290.505796:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828672e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.505825:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828672e expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.505834:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828672e expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.505852:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000088ffa997, rc 0) 00000100:00100000:0.0:1790100290.505896:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091c89d3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140872832:12345-0@lo:101: Request processed in 122us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.505902:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100290.506107:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b48db793 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140872832:0@lo:101: 00010000:00010000:2.0:1790100290.506127:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.506135:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100290.506190:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140872960:0@lo:256: 00000100:00100000:2.0:1790100290.506218:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100290.506242:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038510a1e going to sleep for 11 seconds 00000100:00100000:1.0:1790100290.506494:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140872960 00000100:00100000:1.0:1790100290.506499:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140872960 00000100:00100000:1.0:1790100290.506520:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100290.506525:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8aa4620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140872960:12345-0@lo:256: 20000000:01000000:1.0:1790100290.506537:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790100290.506552:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790100290.506554:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790100290.506623:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8aa4620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140872960:12345-0@lo:256: Request processed in 97us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100290.506639:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100290.506735:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140872960:0@lo:256: 10000000:01000000:2.0:1790100290.506773:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790100290.506778:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.506786:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1790100290.864132:0:6942:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790100290.864310:0:6942:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1790100291.017316:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790100291.017324:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790100291.017327:0:36:0:(import.c:65:import_set_state_nolock()) 00000000c9e3f6f3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100291.017389:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c9e3f6f3 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100291.017412:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000093503c8b x1877056140873216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100291.017513:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093503c8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056140873216:0@lo:38: 00000100:00100000:1.0:1790100291.017630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100291.017782:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b29b2bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140873088:0@lo:400: 00000100:00100000:3.0:1790100291.017815:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100291.017950:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140873216 00000100:00100000:0.0:1790100291.017960:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140873216 00000100:00100000:0.0:1790100291.017992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100291.017998:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090c55822 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877056140873216:12345-0@lo:38: 00010000:00080000:0.0:1790100291.018020:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:0.0:1790100291.018054:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc87a4f229828673c 00000004:00100000:0.0:1790100291.018092:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790100291.018231:0:6514:0:(import.c:65:import_set_state_nolock()) 0000000003601a28 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100291.018287:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090c55822 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877056140873216:12345-0@lo:38: Request processed in 288us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100291.018299:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790100291.018337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000093503c8b x1877056140873216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790100291.018407:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790100291.018414:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790100291.018419:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790100291.018432:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000c9e3f6f3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790100291.018438:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093503c8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056140873216:0@lo:38: 00000100:00100000:1.0:1790100291.018714:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140873088 00000100:00100000:1.0:1790100291.018720:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140873088 00000100:00100000:1.0:1790100291.018763:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790100291.018771:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000120b1377 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+12:3643:x1877056140873088:12345-0@lo:400: 00000100:00100000:1.0:1790100291.018826:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000120b1377 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+12:3643:x1877056140873088:12345-0@lo:400: Request processed in 56us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100291.018832:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790100291.018865:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b29b2bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140873088:0@lo:400: 00010000:00010000:2.0:1790100291.402787:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100292.425124:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100293.448573:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100294.472545:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100295.496495:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100296.139374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e37cef7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140873344:0@lo:400: 00000100:00100000:1.0:1790100296.139383:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018db7593 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140873472:0@lo:400: 00000100:00100000:3.0:1790100296.139623:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100296.139665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100296.139693:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140873344 00000100:00100000:3.0:1790100296.139701:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140873344 00000100:00100000:1.0:1790100296.139720:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140873472 00000100:00100000:1.0:1790100296.139726:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140873472 00000100:00100000:3.0:1790100296.139763:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790100296.139769:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100296.139774:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000779fc27c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:3644:x1877056140873344:12345-0@lo:400: 00000100:00100000:1.0:1790100296.139781:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004fa49b03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140873472:12345-0@lo:400: 00000100:00100000:3.0:1790100296.139829:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000779fc27c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:3644:x1877056140873344:12345-0@lo:400: Request processed in 58us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100296.139838:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790100296.139848:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004fa49b03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140873472:12345-0@lo:400: Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100296.139856:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100296.139892:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e37cef7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140873344:0@lo:400: 00010000:00080000:1.0:1790100296.139898:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000018db7593 x1877056140873472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100296.139911:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018db7593 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140873472:0@lo:400: 00010000:00010000:1.0:1790100296.520560:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790100297.408648:0:7440:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790100297.408652:0:7440:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790100297.408653:0:7440:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790100297.408817:0:7440:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000365c5593 00000020:01000004:3.0:1790100297.408832:0:7440:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1790100297.408843:0:7440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790100297.408856:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000004525a116) 00000020:00000080:3.0:1790100297.408870:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790100297.440754:0:7440:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1790100297.440869:0:7440:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1790100297.456220:0:7440:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790100297.456464:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1790100297.456474:0:7440:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790100297.456486:0:7440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f229828674a 00000020:01000004:1.0:1790100297.456492:0:7440:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790100297.456510:0:7440:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790100297.456513:0:7440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790100297.456520:0:7440:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1790100297.456559:0:7440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1790100297.456563:0:7440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790100297.474993:0:7440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100297.475032:0:7440:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1790100297.475036:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100297.475038:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790100297.475039:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100297.475039:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100297.475041:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100297.475042:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100297.475043:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100297.475044:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100297.475046:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100297.475047:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100297.475048:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100297.475051:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1790100297.475053:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100297.475054:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790100297.475055:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100297.475056:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100297.475058:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100297.475059:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100297.475059:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100297.475060:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100297.475061:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100297.475062:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100297.475063:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100297.475092:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790100297.475108:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140873600:0@lo:253: 00000100:00100000:2.0:1790100297.475181:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.475277:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5d36b05 going to sleep for 11 seconds 00000100:00100000:0.0:1790100297.475325:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140873600 00000100:00100000:0.0:1790100297.475333:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140873600 00000100:00100000:0.0:1790100297.475600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100297.475613:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff37f2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140873600:12345-0@lo:253: 20000000:01000000:0.0:1790100297.475640:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790100297.475643:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1790100297.475648:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1790100297.475650:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1790100297.475678:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1790100297.475837:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100297.475979:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790100297.475996:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790100297.476013:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1790100297.476030:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1790100297.476047:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1790100297.476098:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1790100297.476107:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1790100297.476120:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1790100297.476138:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1790100297.476150:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1790100297.476154:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1790100297.476165:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1790100297.476176:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1790100297.476271:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1790100297.476282:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1790100297.476297:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1790100297.476303:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790100297.476314:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1790100297.476319:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1790100297.476330:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1790100297.476335:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790100297.476556:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1790100297.476577:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1790100297.476597:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1790100297.476673:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1790100297.476684:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1790100297.476698:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1790100297.476715:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1790100297.476733:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1790100297.476740:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1790100297.476754:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1790100297.476775:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1790100297.476781:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1790100297.476802:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790100297.476809:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1790100297.477194:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1790100297.477439:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1790100297.477457:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:0.0:1790100297.477458:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1790100297.477475:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1790100297.477481:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790100297.477493:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1790100297.477498:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1790100297.477514:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1790100297.477521:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1790100297.477534:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1790100297.477549:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1790100297.477593:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1790100297.477601:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1790100297.477844:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1790100297.477984:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1790100297.477998:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:0.0:1790100297.477999:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1790100297.478013:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1790100297.478019:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790100297.478032:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1790100297.478045:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1790100297.478060:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1790100297.478067:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1790100297.478080:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1790100297.478095:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1790100297.478113:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790100297.478116:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790100297.478120:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790100297.478173:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790100297.478175:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790100297.478718:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1790100297.478739:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1790100297.478767:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1790100297.478906:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1790100297.478927:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1790100297.478940:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1790100297.478950:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1790100297.478952:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790100297.479248:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790100297.479267:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790100297.479281:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1790100297.479527:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1790100297.479562:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1790100297.479579:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1790100297.479590:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790100297.479591:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790100297.479811:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1790100297.479830:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1790100297.479845:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1790100297.479976:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1790100297.479993:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1790100297.480012:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1790100297.480023:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790100297.480025:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790100297.480029:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790100297.480034:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790100297.480330:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1790100297.480544:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790100297.489487:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790100297.489647:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.489678:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828667f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.489686:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828669b expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.489691:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828670b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.489697:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.489733:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828670b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.489745:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828670b expref: 12 pid: 6505 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100297.489757:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007e64062 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140873728:0@lo:104: 00000100:00100000:0.0:1790100297.489810:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100297.489857:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828669b expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.489864:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828669b expref: 12 pid: 6507 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100297.489872:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081a36eca pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140873856:0@lo:104: 00000100:00100000:0.0:1790100297.489890:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.489913:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140873728 00000100:00100000:0.0:1790100297.489924:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140873728 00000100:00100000:0.0:1790100297.489956:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140873856 00000100:00100000:0.0:1790100297.489958:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140873856 00000100:00100000:0.0:1790100297.489969:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100297.489976:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db178090 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140873728:12345-0@lo:104: 00010000:00010000:0.0:1790100297.489986:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.490029:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100297.490034:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db178090 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140873728:12345-0@lo:104: Request processed in 59us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.490040:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100297.490055:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100297.490187:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c376cbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140873856:12345-0@lo:104: 00010000:00010000:0.0:1790100297.490195:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.490237:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790100297.490241:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c376cbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140873856:12345-0@lo:104: Request processed in 181us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.490247:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790100297.490271:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828667f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.490279:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828667f expref: 12 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100297.490286:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140873984:0@lo:104: 00000100:00100000:0.0:1790100297.490308:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.490334:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140873984 00000100:00100000:0.0:1790100297.490374:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140873984 00000100:00100000:0.0:1790100297.490393:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100297.490398:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000053e693 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140873984:12345-0@lo:104: 00010000:00010000:0.0:1790100297.490405:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.490432:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790100297.490436:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000053e693 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140873984:12345-0@lo:104: Request processed in 38us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.490441:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100297.490622:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fae0d84 going to sleep for 11 seconds 00000100:00100000:0.0:1790100297.490642:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007e64062 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140873728:0@lo:104: 00000100:00100000:0.0:1790100297.490651:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081a36eca pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140873856:0@lo:104: 00000100:00100000:0.0:1790100297.490657:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140873984:0@lo:104: 00010000:00010000:0.0:1790100297.490673:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490740:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790100297.490746:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490753:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c3787fd0 already unused, calling callback (00000000826b2a0f) 10000000:00010000:2.0:1790100297.490756:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490763:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100297.490770:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100297.490775:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100297.490807:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490814:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100297.490831:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490838:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000c3787fd0/0xc87a4f229828670b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286712 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490848:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100297.490851:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490863:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000031334254 already unused, calling callback (00000000826b2a0f) 10000000:00010000:2.0:1790100297.490865:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490871:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100297.490876:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100297.490881:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100297.490894:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490899:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100297.490915:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490921:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000031334254/0xc87a4f229828669b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982866a2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490930:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100297.490932:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490938:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000025784de1 already unused, calling callback (00000000826b2a0f) 10000000:00010000:2.0:1790100297.490939:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490956:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100297.490962:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100297.490967:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100297.490979:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490985:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100297.490989:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.490995:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f229828667f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286686 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.491008:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100297.491009:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100297.491011:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100297.491021:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c87ed8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140874240:0@lo:103: 00000100:00100000:2.0:1790100297.491050:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.491082:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100297.491088:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a8e82cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140874368:0@lo:103: 00000100:00100000:2.0:1790100297.491108:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.491178:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140874240 00000100:00100000:2.0:1790100297.491182:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140874240 00010000:00010000:2.0:1790100297.491198:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828669b expref: 13 pid: 6507 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100297.491229:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140874368 00000100:00100000:2.0:1790100297.491232:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140874368 00010000:00010000:2.0:1790100297.491244:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828667f expref: 14 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100297.491256:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100297.491262:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ffbb297 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+14:3643:x1877056140874240:12345-0@lo:103: 00010000:00010000:2.0:1790100297.491271:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100297.491275:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828669b expref: 14 pid: 6507 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.491283:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828669b expref: 14 pid: 6507 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.491293:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000110dbe98/0xc87a4f22982866a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828669b expref: 14 pid: 6507 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.491303:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100297.491328:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ffbb297 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+13:3643:x1877056140874240:12345-0@lo:103: Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.491334:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100297.491368:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100297.491373:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000453bda6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+12:3643:x1877056140874368:12345-0@lo:103: 00010000:00010000:2.0:1790100297.491380:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100297.491384:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828667f expref: 12 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.491390:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828667f expref: 12 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.491404:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a706e5b9/0xc87a4f2298286686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828667f expref: 12 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.491411:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100297.491429:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000453bda6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+11:3643:x1877056140874368:12345-0@lo:103: Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.491434:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100297.491459:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a8e82cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140874368:0@lo:103: 00000100:00100000:2.0:1790100297.491466:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c87ed8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140874240:0@lo:103: 00010000:00010000:0.0:1790100297.491704:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100297.491752:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b52c64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140874112:0@lo:103: 00000100:00100000:1.0:1790100297.491782:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.492138:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140874112 00000100:00100000:2.0:1790100297.492142:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140874112 00010000:00010000:2.0:1790100297.492157:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828670b expref: 11 pid: 6505 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100297.492217:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100297.492224:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018db7593 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+11:3642:x1877056140874112:12345-0@lo:103: 00010000:00010000:2.0:1790100297.492232:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100297.492235:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828670b expref: 11 pid: 6505 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492243:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828670b expref: 11 pid: 6505 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492252:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000236ae7cd/0xc87a4f2298286712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828670b expref: 11 pid: 6505 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492263:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492276:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492288:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492295:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492300:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492306:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492312:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc6fd861 already unused, calling callback (00000000d6f996eb) 00010000:00010000:2.0:1790100297.492315:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492321:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492355:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.492364:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100297.492393:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018db7593 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+10:3642:x1877056140874112:12345-0@lo:103: Request processed in 170us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.492399:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100297.492457:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b52c64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140874112:0@lo:103: 00010000:00010000:1.0:1790100297.492477:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.492483:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.492489:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286751 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790100297.492503:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790100297.494244:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff37f2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+9:7440:x1877056140873600:12345-0@lo:253: Request processed in 18627us (19059us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.494256:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790100297.494379:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140873600:0@lo:253: 10000000:01000000:2.0:1790100297.494399:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790100297.494401:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790100297.494403:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790100297.494404:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100297.494405:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1790100297.494407:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100297.494408:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100297.494409:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100297.494411:0:7440:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790100297.494412:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100297.494414:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790100297.494428:0:7440:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000365c5593 from lustre-MDT0001 10000000:01000000:2.0:1790100297.494460:0:7440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1790100297.494462:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790100297.494468:0:7440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9261b2304d40 local copy 10000000:01000000:2.0:1790100297.494472:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790100297.494500:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.494508:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.494516:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100297.494529:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140874496:0@lo:101: 00000100:00100000:2.0:1790100297.494559:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.494586:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000979c9eb5 going to sleep for 11 seconds 00000100:00100000:3.0:1790100297.494759:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140874496 00000100:00100000:3.0:1790100297.494766:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140874496 00000100:00100000:3.0:1790100297.494799:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790100297.494807:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d3b42cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+9:7440:x1877056140874496:12345-0@lo:101: 00010000:00010000:3.0:1790100297.494817:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100297.494827:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e15baf8d/0xc87a4f229828675f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286758 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.494846:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e15baf8d/0xc87a4f229828675f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286758 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.494855:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e15baf8d/0xc87a4f229828675f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286758 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.494863:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e15baf8d, rc 0) 00000100:00100000:3.0:1790100297.494902:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d3b42cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+10:7440:x1877056140874496:12345-0@lo:101: Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.494908:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100297.495052:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140874496:0@lo:101: 00010000:00010000:2.0:1790100297.495063:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.495083:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100297.495181:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140874624:0@lo:501: 00000100:00100000:2.0:1790100297.495214:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.495237:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000979c9eb5 going to sleep for 11 seconds 00000100:00100000:0.0:1790100297.495280:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140874624 00000100:00100000:0.0:1790100297.495284:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140874624 00000100:00100000:0.0:1790100297.495314:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100297.495320:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000629d51f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+10:7440:x1877056140874624:12345-0@lo:501: 00000100:00100000:0.0:1790100297.495400:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000629d51f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+10:7440:x1877056140874624:12345-0@lo:501: Request processed in 81us (186us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100297.495414:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100297.495532:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140874624:0@lo:501: 10000000:01000000:2.0:1790100297.495545:0:7440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790100297.495561:0:7440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790100297.495566:0:7440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.495573:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.495578:0:7440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.495603:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790100297.495623:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9261b2026000 10000000:01000000:2.0:1790100297.495628:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790100297.495632:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9261b2304d40 10000000:01000000:2.0:1790100297.495634:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1790100297.495636:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9261b2304d40 from 1 10000000:01000000:2.0:1790100297.495638:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1790100297.495651:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000dff72e95/0xc87a4f2298286766 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.495668:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000dff72e95/0xc87a4f2298286766 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.495675:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000dff72e95/0xc87a4f2298286766 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100297.495686:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140874752:0@lo:101: 00000100:00100000:2.0:1790100297.495711:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.495733:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047c72c92 going to sleep for 11 seconds 00010000:00010000:1.0:1790100297.495769:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100297.495774:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.495780:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000082bc7212 already unused, calling callback (00000000826b2a0f) 10000000:00010000:1.0:1790100297.495787:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.495794:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100297.495800:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100297.495805:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100297.495821:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.495827:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100297.495850:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.495856:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000082bc7212/0xc87a4f2298286758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f229828675f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.495869:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100297.495870:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100297.495872:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100297.495878:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100297.495886:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016141920 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140874880:0@lo:103: 00000100:00100000:1.0:1790100297.495911:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100297.495941:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140874880 00000100:00100000:1.0:1790100297.495945:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140874880 00000100:00100000:1.0:1790100297.495969:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100297.495974:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005bf799c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+10:3642:x1877056140874880:12345-0@lo:103: 00010000:00010000:1.0:1790100297.495982:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100297.495995:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e15baf8d/0xc87a4f229828675f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286758 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.496007:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100297.496031:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005bf799c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+9:3642:x1877056140874880:12345-0@lo:103: Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.496037:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100297.496061:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016141920 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140874880:0@lo:103: 00000100:00100000:0.0:1790100297.496119:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140874752 00000100:00100000:0.0:1790100297.496133:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140874752 00000100:00100000:0.0:1790100297.496164:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790100297.496170:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f956012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+9:7440:x1877056140874752:12345-0@lo:101: 00010000:00010000:0.0:1790100297.496177:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100297.496187:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1fe6324/0xc87a4f229828676d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286766 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.496202:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1fe6324/0xc87a4f229828676d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286766 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.496210:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1fe6324/0xc87a4f229828676d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286766 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.496216:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1fe6324, rc 0) 00000100:00100000:0.0:1790100297.496242:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f956012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+10:7440:x1877056140874752:12345-0@lo:101: Request processed in 72us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.496247:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790100297.496370:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140874752:0@lo:101: 00010000:00010000:2.0:1790100297.496380:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000dff72e95/0xc87a4f2298286766 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828676d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.496387:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000dff72e95/0xc87a4f2298286766 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f229828676d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100297.496399:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790100297.496405:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000dff72e95/0xc87a4f2298286766 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828676d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.496410:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000dff72e95/0xc87a4f2298286766 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828676d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100297.496416:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9261b2026000 10000000:01000000:2.0:1790100297.496419:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790100297.496422:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9261b2026000 from 1 10000000:01000000:2.0:1790100297.496423:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790100297.496434:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d73664bd/0xc87a4f2298286774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.496445:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000d73664bd/0xc87a4f2298286774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.496451:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000d73664bd/0xc87a4f2298286774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100297.496461:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875008:0@lo:101: 00000100:00100000:2.0:1790100297.496482:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.496503:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047c72c92 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.496553:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140875008 00000100:00100000:1.0:1790100297.496557:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140875008 00000100:00100000:1.0:1790100297.496588:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790100297.496593:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d959da5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+10:7440:x1877056140875008:12345-0@lo:101: 00010000:00010000:1.0:1790100297.496599:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100297.496606:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000331cd71c/0xc87a4f229828677b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286774 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.496618:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000331cd71c/0xc87a4f229828677b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286774 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.496625:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000331cd71c/0xc87a4f229828677b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286774 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.496631:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000331cd71c, rc 0) 00000100:00100000:1.0:1790100297.496656:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d959da5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+11:7440:x1877056140875008:12345-0@lo:101: Request processed in 63us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.496662:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790100297.496758:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875008:0@lo:101: 00010000:00010000:2.0:1790100297.496767:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000d73664bd/0xc87a4f2298286774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.496773:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000d73664bd/0xc87a4f2298286774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100297.496783:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790100297.496797:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d73664bd/0xc87a4f2298286774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.496803:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000d73664bd/0xc87a4f2298286774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100297.496809:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790100297.496813:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790100297.496816:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9261b2026000 10000000:01000000:2.0:1790100297.496818:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790100297.496821:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1790100297.496828:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790100297.496840:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c00ad44d/0xc87a4f2298286782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.496845:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000c00ad44d/0xc87a4f2298286782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100297.496851:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000c00ad44d/0xc87a4f2298286782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100297.496862:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875136:0@lo:101: 00000100:00100000:2.0:1790100297.496886:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.496911:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047c72c92 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.496970:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140875136 00000100:00100000:1.0:1790100297.496975:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140875136 00000100:00100000:1.0:1790100297.497001:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790100297.497012:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b8befb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+11:7440:x1877056140875136:12345-0@lo:101: 00010000:00010000:1.0:1790100297.497019:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100297.497025:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f140008/0xc87a4f2298286789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286782 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.497035:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f140008/0xc87a4f2298286789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286782 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.497042:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f140008/0xc87a4f2298286789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286782 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.497048:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f140008, rc 0) 00000100:00100000:1.0:1790100297.497080:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b8befb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875136:12345-0@lo:101: Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.497086:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790100297.497148:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d4e1ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875136:0@lo:101: 00010000:00010000:0.0:1790100297.497158:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000c00ad44d/0xc87a4f2298286782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.497164:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000c00ad44d/0xc87a4f2298286782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100297.497225:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875264:0@lo:501: 00000100:00100000:0.0:1790100297.497248:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.497276:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef04c0b7 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.497315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140875264 00000100:00100000:1.0:1790100297.497319:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140875264 00000100:00100000:1.0:1790100297.497367:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790100297.497373:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000365ce6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875264:12345-0@lo:501: 00000100:00100000:1.0:1790100297.497456:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000365ce6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875264:12345-0@lo:501: Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.497463:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790100297.497531:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875264:0@lo:501: 00000100:00100000:0.0:1790100297.497556:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875392:0@lo:503: 00000100:00100000:0.0:1790100297.497592:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.497611:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef04c0b7 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.497651:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140875392 00000100:00100000:1.0:1790100297.497655:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140875392 00000100:00100000:1.0:1790100297.497682:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100297.497689:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039a8a56e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875392:12345-0@lo:503: 00000100:00100000:1.0:1790100297.497759:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039a8a56e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875392:12345-0@lo:503: Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.497774:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790100297.497844:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875392:0@lo:503: 00000040:00080000:0.0:1790100297.498081:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100297.498151:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875520:0@lo:502: 00000100:00100000:0.0:1790100297.498182:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.498200:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef04c0b7 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.498240:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140875520 00000100:00100000:1.0:1790100297.498244:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140875520 00000100:00100000:1.0:1790100297.498271:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790100297.498278:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000adcd0626 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875520:12345-0@lo:502: 00000100:00100000:1.0:1790100297.498362:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000adcd0626 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875520:12345-0@lo:502: Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.498368:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790100297.498438:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875520:0@lo:502: 00000040:00080000:0.0:1790100297.498609:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790100297.498632:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1790100297.498658:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1790100297.498675:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1790100297.498687:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1790100297.498701:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1790100297.498713:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1790100297.498724:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1790100297.498735:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1790100297.498745:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1790100297.498755:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1790100297.498765:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1790100297.498776:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1790100297.498786:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1790100297.498796:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1790100297.498808:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1790100297.498820:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1790100297.498830:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1790100297.498857:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1790100297.498870:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1790100297.498881:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1790100297.498892:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1790100297.498902:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1790100297.498920:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875648:0@lo:502: 00000100:00100000:0.0:1790100297.498950:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.498971:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef04c0b7 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.499011:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140875648 00000100:00100000:1.0:1790100297.499016:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140875648 00000100:00100000:1.0:1790100297.499045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790100297.499051:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009ac63997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875648:12345-0@lo:502: 00000100:00100000:1.0:1790100297.499109:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009ac63997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140875648:12345-0@lo:502: Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.499115:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790100297.499214:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c387601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140875648:0@lo:502: 00000040:00080000:0.0:1790100297.499248:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1790100297.499255:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1790100297.499717:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100297.499727:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100297.499729:0:7452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790100297.499735:0:7452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1790100297.499737:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100297.499755:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000008d2fac3b) 00000020:00000080:1.0:1790100297.499772:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1790100297.499784:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790100297.499859:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790100297.499866:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f2298286797 00000020:00000080:1.0:1790100297.500069:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1790100297.500074:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100297.500077:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100297.500085:0:7452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790100297.500089:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100297.500092:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100297.500094:0:7452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1790100297.500097:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100297.500103:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a4a815d5) 00000020:00000080:1.0:1790100297.500114:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1790100297.500118:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790100297.500120:0:7452:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1790100297.500135:0:7452:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1790100297.500141:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790100297.500183:0:7452:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000365c5593 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1790100297.500195:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000604cd650) 00000020:00000080:1.0:1790100297.500203:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1790100297.500258:0:7452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790100297.500264:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f22982867ac 00000020:00000080:1.0:1790100297.500479:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1790100297.500487:0:7452:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790100297.500491:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc87a4f22982867b3 00080000:01000000:1.0:1790100297.500496:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790100297.500499:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f22982867ba 00080000:10000000:1.0:1790100297.500860:0:7452:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1790100297.500983:0:7452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1790100297.544490:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100297.562330:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1790100297.562862:0:7452:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1790100297.565814:0:7452:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1790100297.566207:0:7452:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790100297.574258:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790100297.574270:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100297.574275:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100297.574277:0:7452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790100297.574287:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100297.574293:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100297.574294:0:7452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790100297.574297:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790100297.574302:0:7452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:00000080:3.0:1790100297.574329:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790100297.574377:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000e79ca447) 00000020:00000080:3.0:1790100297.574399:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1790100297.574405:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790100297.574466:0:7452:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790100297.574473:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790100297.574479:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f22982867c8 00010000:00080000:3.0:1790100297.574508:0:7452:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000efcf1720@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1790100297.576966:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1790100297.578831:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790100297.578845:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790100297.578876:0:7452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790100297.578894:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f22982867cf 00000100:00080000:3.0:1790100297.578903:0:7452:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790100297.578912:0:7452:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000efcf1720 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100297.578946:0:7452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006f041fbe x1877056140875776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790100297.578972:0:7452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790100297.578990:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f041fbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056140875776:0@lo:38: 00000020:01000000:3.0:1790100297.579013:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100297.579016:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100297.579018:0:7452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1790100297.579020:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790100297.579022:0:7452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1790100297.579023:0:7452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790100297.579025:0:7452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790100297.579026:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790100297.579032:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100297.579034:0:7452:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790100297.579036:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100297.579040:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100297.579041:0:7452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1790100297.579044:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790100297.579099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:3.0:1790100297.579175:0:7452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790100297.579190:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100297.579194:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100297.579195:0:7452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1790100297.579198:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100297.579200:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100297.579201:0:7452:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790100297.579204:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790100297.579205:0:7452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790100297.579212:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140875776 00000100:00100000:1.0:1790100297.579218:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140875776 00000020:01000000:3.0:1790100297.579229:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100297.579232:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100297.579233:0:7452:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790100297.579236:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1790100297.579248:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100297.579254:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016141920 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1877056140875776:12345-0@lo:38: 00010000:00080000:1.0:1790100297.579272:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1790100297.579308:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f22982867d6 00000004:00100000:1.0:1790100297.579322:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790100297.579328:0:6517:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1790100297.579377:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000968c32b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140875904:0@lo:400: 00000100:00100000:0.0:1790100297.579406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1790100297.579432:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1790100297.579459:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790100297.579471:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c00ad44d/0xc87a4f2298286782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.579480:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000c00ad44d/0xc87a4f2298286782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100297.579488:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9261b2026000 from 1 10000000:01000000:0.0:1790100297.579491:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100297.579510:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.579527:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.579535:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100297.579547:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081a36eca pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876032:0@lo:101: 00000100:00100000:0.0:1790100297.579573:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100297.579596:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140876032 00000100:00100000:0.0:1790100297.579597:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc4b9890 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.579601:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140876032 00000100:00100000:1.0:1790100297.579637:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100297.579644:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000803865a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:7440:x1877056140876032:12345-0@lo:101: 00010000:00010000:1.0:1790100297.579654:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790100297.579657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140875904 00000100:00100000:3.0:1790100297.579661:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140875904 00010000:00010000:1.0:1790100297.579663:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982867dd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.579681:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982867dd expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100297.579685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100297.579690:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c387601 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140875904:12345-0@lo:400: 00010000:00010000:1.0:1790100297.579691:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982867dd expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100297.579698:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000504a6eb, rc 0) 00000100:00100000:1.0:1790100297.579726:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000803865a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+13:7440:x1877056140876032:12345-0@lo:101: Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.579731:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790100297.579800:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c387601 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140875904:12345-0@lo:400: Request processed in 109us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.579806:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790100297.579839:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000968c32b7 x1877056140875904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100297.579850:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000968c32b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140875904:0@lo:400: 00000100:00100000:0.0:1790100297.579908:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081a36eca pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876032:0@lo:101: 00010000:00010000:0.0:1790100297.579919:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.579927:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100297.580529:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081a36eca pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876160:0@lo:256: 00000100:00100000:0.0:1790100297.580565:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.580593:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc4b9890 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.581979:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140876160 00000100:00100000:1.0:1790100297.581991:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140876160 00000100:00100000:1.0:1790100297.582103:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790100297.582113:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8d06d6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+13:7440:x1877056140876160:12345-0@lo:256: 20000000:01000000:1.0:1790100297.582148:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790100297.582166:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790100297.582170:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790100297.582732:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8d06d6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+13:7440:x1877056140876160:12345-0@lo:256: Request processed in 619us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.582798:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081a36eca pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876160:0@lo:256: 00000100:00100000:1.0:1790100297.582819:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 10000000:01000000:3.0:1790100297.583437:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790100297.584080:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.584094:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100297.584101:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b2026000 from 1 10000000:01000000:3.0:1790100297.584104:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100297.584143:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.584151:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.584160:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100297.584180:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc55a267 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876288:0@lo:101: 00000100:00100000:3.0:1790100297.584228:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.584267:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:3.0:1790100297.584291:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140876288 00000100:00100000:3.0:1790100297.584299:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140876288 00000100:00100000:3.0:1790100297.584336:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100297.584365:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020575173 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+13:7440:x1877056140876288:12345-0@lo:101: 00010000:00010000:3.0:1790100297.584377:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100297.584388:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982867eb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.584409:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982867eb expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.584426:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982867eb expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.584434:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e15baf8d, rc 0) 00000100:00100000:3.0:1790100297.584468:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020575173 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:7440:x1877056140876288:12345-0@lo:101: Request processed in 105us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.584474:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100297.584519:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc55a267 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876288:0@lo:101: 00010000:00010000:3.0:1790100297.584533:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.584542:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100297.584626:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc55a267 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876416:0@lo:501: 00000100:00100000:3.0:1790100297.584649:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.584669:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:2.0:1790100297.584834:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140876416 00000100:00100000:2.0:1790100297.584840:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140876416 00000100:00100000:2.0:1790100297.584877:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100297.584885:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ff53686 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:7440:x1877056140876416:12345-0@lo:501: 00000100:00100000:2.0:1790100297.584995:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ff53686 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:7440:x1877056140876416:12345-0@lo:501: Request processed in 110us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.585002:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790100297.585140:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc55a267 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876416:0@lo:501: 00000100:00100000:3.0:1790100297.585167:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc55a267 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876544:0@lo:503: 00000100:00100000:3.0:1790100297.585203:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.585230:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:2.0:1790100297.585243:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140876544 00000100:00100000:2.0:1790100297.585248:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140876544 00000100:00100000:2.0:1790100297.585279:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100297.585286:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e266db02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:7440:x1877056140876544:12345-0@lo:503: 00000040:00080000:2.0:1790100297.585317:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790100297.585373:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e266db02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:7440:x1877056140876544:12345-0@lo:503: Request processed in 88us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.585380:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790100297.585406:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc55a267 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876544:0@lo:503: 00000040:00080000:0.0:1790100297.585617:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100297.585657:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1790100297.585730:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100297.587308:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1790100297.587418:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790100297.587453:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100297.587478:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.587501:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100297.587544:0:7440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790100297.587546:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9261b2026000 10000000:01000000:0.0:1790100297.587549:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9261b2026000 10000000:01000000:0.0:1790100297.587552:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790100297.587556:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b2026000 from 1 10000000:01000000:0.0:1790100297.587559:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790100297.587584:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000a706e5b9/0xc87a4f22982867f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.587590:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000a706e5b9/0xc87a4f22982867f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.587598:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000a706e5b9/0xc87a4f22982867f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100297.587613:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007e64062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876672:0@lo:101: 00000100:00100000:0.0:1790100297.587660:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.587690:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6a79ab0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100297.587717:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140876672 00000100:00100000:0.0:1790100297.587723:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140876672 00000100:00100000:0.0:1790100297.587754:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790100297.587760:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000003d3953c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:7440:x1877056140876672:12345-0@lo:101: 00010000:00010000:0.0:1790100297.587771:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100297.587780:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982867f9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.587807:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.587815:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc6fd861/0xc87a4f2298286800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.587822:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc6fd861, rc 0) 00000100:00100000:0.0:1790100297.587850:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000003d3953c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140876672:12345-0@lo:101: Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.587855:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790100297.587894:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007e64062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876672:0@lo:101: 00010000:00010000:0.0:1790100297.587904:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000a706e5b9/0xc87a4f22982867f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.587910:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000a706e5b9/0xc87a4f22982867f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100297.587969:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007e64062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876800:0@lo:501: 00000100:00100000:0.0:1790100297.587990:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.588002:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6a79ab0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100297.588232:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140876800 00000100:00100000:3.0:1790100297.588237:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140876800 00000100:00100000:3.0:1790100297.588269:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100297.588276:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c513af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140876800:12345-0@lo:501: 00000100:00100000:3.0:1790100297.588405:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c513af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140876800:12345-0@lo:501: Request processed in 129us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.588419:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790100297.588422:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007e64062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876800:0@lo:501: 00000100:00100000:2.0:1790100297.588457:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c87ed8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876928:0@lo:503: 00000100:00100000:2.0:1790100297.588501:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.588526:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000979c9eb5 going to sleep for 11 seconds 00000100:00100000:0.0:1790100297.588660:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140876928 00000100:00100000:0.0:1790100297.588665:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140876928 00000100:00100000:0.0:1790100297.588693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790100297.588708:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a81aad1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140876928:12345-0@lo:503: 00000100:00100000:0.0:1790100297.588785:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a81aad1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140876928:12345-0@lo:503: Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.588791:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790100297.588883:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c87ed8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140876928:0@lo:503: 00000040:00080000:2.0:1790100297.589135:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1790100297.589196:0:6517:0:(import.c:65:import_set_state_nolock()) 000000006a1edbb5 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100297.589208:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c87ed8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140877056:0@lo:502: 00000100:00100000:2.0:1790100297.589251:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.589276:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000979c9eb5 going to sleep for 11 seconds 00000100:00100000:0.0:1790100297.589304:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140877056 00000100:00100000:0.0:1790100297.589309:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140877056 00000100:00100000:0.0:1790100297.589334:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790100297.589359:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8517d9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140877056:12345-0@lo:502: 00000100:00100000:0.0:1790100297.589430:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8517d9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140877056:12345-0@lo:502: Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.589436:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790100297.589469:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c87ed8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140877056:0@lo:502: 00000040:00080000:0.0:1790100297.589602:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790100297.589626:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790100297.589641:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790100297.589654:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790100297.589666:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790100297.589678:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790100297.589691:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790100297.589717:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790100297.589733:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790100297.589745:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790100297.589758:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790100297.589771:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790100297.589785:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790100297.589798:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790100297.589809:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790100297.589820:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790100297.589832:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790100297.589843:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790100297.589855:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790100297.589866:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790100297.589879:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790100297.589893:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790100297.589907:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790100297.589932:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790100297.589946:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790100297.589957:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790100297.589970:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790100297.589983:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1790100297.590003:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140877184:0@lo:502: 00000100:00100000:0.0:1790100297.590037:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.590154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140877184 00000100:00100000:2.0:1790100297.590160:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140877184 00000100:00100000:0.0:1790100297.590209:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc4b9890 going to sleep for 11 seconds 00000100:00100000:2.0:1790100297.590266:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790100297.590274:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016141920 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1877056140875776:12345-0@lo:38: Request processed in 11017us (11174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.590277:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4a9b552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140877184:12345-0@lo:502: 00000100:00100000:1.0:1790100297.590290:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100297.590458:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100297.590467:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1790100297.590474:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790100297.590479:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790100297.590482:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000efcf1720 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790100297.590534:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f041fbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056140875776:0@lo:38: 00000100:00100000:2.0:1790100297.590623:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4a9b552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140877184:12345-0@lo:502: Request processed in 350us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.590631:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790100297.590635:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008be42e01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140877312:0@lo:41: 00000100:00100000:1.0:1790100297.590671:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.590775:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140877312 00000100:00100000:3.0:1790100297.590780:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140877312 00000100:00100000:3.0:1790100297.590810:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100297.590815:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e056889 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1877056140877312:12345-0@lo:41: 00000004:00000024:3.0:1790100297.590836:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1790100297.590916:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140877184:0@lo:502: 00000040:00080000:0.0:1790100297.590963:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790100297.590973:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:3.0:1790100297.591188:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e056889 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1877056140877312:12345-0@lo:41: Request processed in 372us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.591195:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1790100297.591500:0:7458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790100297.591512:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000004507b1d8) 00000020:00000080:3.0:1790100297.591530:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1790100297.591620:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000365c5593 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790100297.591624:0:7458:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000365c5593 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790100297.591626:0:7458:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000365c5593 3 00010000:00080000:3.0:1790100297.591664:0:7458:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e6947efe@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.113@tcp at head 00000100:00100000:1.0:1790100297.592219:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008be42e01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140877312:0@lo:41: 00010000:00010000:3.0:1790100297.593631:0:7458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1790100297.593893:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1790100297.593932:0:7458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790100297.593944:0:7458:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc87a4f229828680e 00000100:00080000:3.0:1790100297.593953:0:7458:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790100297.593967:0:7458:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000e6947efe using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100297.593997:0:7458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006f041fbe x1877056140877440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100297.594087:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f041fbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877056140877440:0@lo:38: 00000100:00100000:1.0:1790100297.594157:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790100297.594217:0:7458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1790100297.594424:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1790100297.594538:0:7459:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1790100297.594782:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790100297.594814:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100297.594836:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000a706e5b9/0xc87a4f22982867f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100297.594846:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000a706e5b9/0xc87a4f22982867f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790100297.594894:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790100297.594897:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790100297.594899:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100297.594900:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100297.594901:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100297.594903:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100297.594904:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790100297.594905:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790100297.594907:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790100297.594908:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100297.594910:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790100297.594913:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1790100297.594916:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790100297.594917:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790100297.594925:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100297.594926:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100297.594927:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100297.594928:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100297.594929:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790100297.594930:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790100297.594931:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790100297.594932:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100297.594932:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790100297.594951:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790100297.594961:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140877568:0@lo:253: 00000100:00100000:0.0:1790100297.595004:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.595031:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa0e2197 going to sleep for 11 seconds 00000100:00100000:0.0:1790100297.595052:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140877568 00000100:00100000:0.0:1790100297.595115:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140877568 00000100:00100000:0.0:1790100297.595166:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790100297.595175:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f1fe7f56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140877568:12345-0@lo:253: 20000000:01000000:0.0:1790100297.595200:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790100297.595215:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1790100297.597928:0:6492:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1790100297.597995:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790100297.598015:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790100297.598032:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140877440 00000100:00100000:1.0:1790100297.598041:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140877440 00000100:00100000:1.0:1790100297.598194:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100297.598200:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c020e931 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1877056140877440:12345-0@lo:38: 00010000:00080000:1.0:1790100297.598224:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1790100297.598270:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc87a4f2298286815 00000004:00100000:1.0:1790100297.598286:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790100297.598315:0:6512:0:(import.c:65:import_set_state_nolock()) 0000000054500d8f : changing import state from RECOVER to FULL 20000000:01000000:3.0:1790100297.598393:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790100297.598397:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790100297.598413:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.598427:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828672e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.598433:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982867dd expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.598439:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.598466:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982867dd expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.598477:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982867dd expref: 15 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100297.598488:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000032c30aa pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140877696:0@lo:104: 00000100:00100000:2.0:1790100297.598630:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f1fe7f56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:7440:x1877056140877568:12345-0@lo:253: Request processed in 3455us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.598641:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790100297.598667:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100297.598720:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828672e expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.598735:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828672e expref: 14 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100297.598744:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d7f65163 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140877824:0@lo:104: 00000100:00100000:3.0:1790100297.598767:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.598790:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3f8aae8 going to sleep for 11 seconds 00000100:00100000:3.0:1790100297.598811:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140877696 00000100:00100000:3.0:1790100297.598815:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140877696 00000100:00100000:3.0:1790100297.598835:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140877824 00000100:00100000:3.0:1790100297.598838:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140877824 00000100:00100000:3.0:1790100297.598850:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100297.598855:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000634b4507 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6528:x1877056140877696:12345-0@lo:104: 00010000:00010000:3.0:1790100297.598866:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.598903:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100297.598908:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000634b4507 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6528:x1877056140877696:12345-0@lo:104: Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.598914:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100297.598926:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100297.598931:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000072b89a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6528:x1877056140877824:12345-0@lo:104: 00010000:00010000:3.0:1790100297.598937:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.598964:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100297.598968:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000072b89a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6528:x1877056140877824:12345-0@lo:104: Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.598981:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790100297.598996:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100297.599000:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.599007:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000608efde4 already unused, calling callback (00000000826b2a0f) 10000000:00010000:3.0:1790100297.599010:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.599017:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100297.599023:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100297.599028:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100297.599051:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.599057:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790100297.599214:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c020e931 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877056140877440:12345-0@lo:38: Request processed in 1012us (5056us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.599221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790100297.599277:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006f041fbe x1877056140877440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100297.599287:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790100297.599295:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1790100297.599306:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790100297.599311:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790100297.599313:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000e6947efe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790100297.599319:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f041fbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877056140877440:0@lo:38: 00010000:00010000:2.0:1790100297.600450:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790100297.600494:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000032c30aa pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140877696:0@lo:104: 00000100:00100000:2.0:1790100297.600505:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d7f65163 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140877824:0@lo:104: 00010000:00010000:2.0:1790100297.600523:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.600824:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.600833:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000608efde4/0xc87a4f22982867dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982867e4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.600844:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100297.600846:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100297.600848:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100297.600919:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100297.600939:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140877952:0@lo:103: 00000100:00100000:3.0:1790100297.600982:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.601022:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140877952 00000100:00100000:3.0:1790100297.601028:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140877952 00010000:00010000:3.0:1790100297.601049:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982867dd expref: 15 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100297.601085:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100297.601092:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000050ee118a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+15:3643:x1877056140877952:12345-0@lo:103: 00010000:00010000:3.0:1790100297.601102:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100297.601106:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982867dd expref: 15 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601114:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982867dd expref: 15 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601138:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000504a6eb/0xc87a4f22982867e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982867dd expref: 15 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601150:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100297.601179:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000050ee118a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+14:3643:x1877056140877952:12345-0@lo:103: Request processed in 88us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.601185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100297.601212:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140877952:0@lo:103: 00010000:00010000:3.0:1790100297.601275:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100297.601280:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601287:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000018e69e08 already unused, calling callback (00000000826b2a0f) 10000000:00010000:3.0:1790100297.601297:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601304:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100297.601309:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100297.601314:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100297.601336:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601358:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100297.601371:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601376:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000018e69e08/0xc87a4f229828672e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601388:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100297.601389:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100297.601390:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100297.601401:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140878080:0@lo:103: 00000100:00100000:3.0:1790100297.601426:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.601455:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140878080 00000100:00100000:3.0:1790100297.601458:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140878080 00010000:00010000:3.0:1790100297.601470:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828672e expref: 14 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100297.601486:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100297.601496:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a06400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+14:3641:x1877056140878080:12345-0@lo:103: 00010000:00010000:3.0:1790100297.601503:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100297.601507:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828672e expref: 14 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601514:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828672e expref: 14 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601522:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088ffa997/0xc87a4f2298286735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828672e expref: 14 pid: 6506 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601531:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601539:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790100297.601550:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003153577s 00010000:00010000:3.0:1790100297.601554:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601560:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601565:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601570:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601575:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000110dbe98 already unused, calling callback (00000000d6f996eb) 00010000:00010000:3.0:1790100297.601582:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601588:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601600:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.601608:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100297.601631:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a06400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+13:3641:x1877056140878080:12345-0@lo:103: Request processed in 135us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100297.601637:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100297.601679:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140878080:0@lo:103: 00010000:00010000:3.0:1790100297.601694:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.602112:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.602119:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000110dbe98/0xc87a4f229828681c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100297.602145:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100297.602147:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100297.602851:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:7440:1877056140877568:0@lo:253: 10000000:01000000:0.0:1790100297.602865:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790100297.602867:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790100297.602869:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790100297.602870:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100297.602871:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100297.602873:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100297.602874:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100297.602875:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790100297.602876:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790100297.602878:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790100297.602879:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100297.602881:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790100297.602894:0:7440:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790100297.608719:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1790100297.608870:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1790100297.609017:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1790100297.609513:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1790100297.609714:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1790100297.609926:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1790100297.614688:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1790100297.614975:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1790100297.615110:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1790100297.615250:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1790100297.615670:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1790100297.615842:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1790100297.617092:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1790100297.617364:0:7465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1790100297.617410:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a8e82cb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7465:1877056140878208:0@lo:700: 00000100:00100000:2.0:1790100297.617468:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.617511:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d0eb057 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.617598:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140878208 00000100:00100000:1.0:1790100297.617605:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140878208 00000100:00100000:1.0:1790100297.617810:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100297.617819:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f1e7060 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7465:x1877056140878208:12345-0@lo:700: 00000040:01000000:3.0:1790100297.617992:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1790100297.618287:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140878336:0@lo:1000: 00000100:00100000:3.0:1790100297.618323:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1790100297.618738:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000020:00080000:0.0:1790100297.618831:0:7464:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1790100297.618836:0:7464:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1790100297.618874:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790100297.619388:0:7440:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790100297.619396:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1790100297.619537:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100297.620650:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790100297.621317:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:3.0:1790100297.621444:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000005871778b going to sleep for 11 seconds 00000040:01000000:2.0:1790100297.622483:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1790100297.622758:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790100297.623074:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:1.0:1790100297.623390:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140878336 00000100:00100000:1.0:1790100297.623400:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140878336 00000100:00100000:1.0:1790100297.623452:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100297.623464:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000050ee118a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140878336:12345-0@lo:1000: 00000100:00100000:1.0:1790100297.623588:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000050ee118a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140878336:12345-0@lo:1000: Request processed in 128us (5264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.623596:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100297.623701:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140878336:0@lo:1000: 00000040:01000000:3.0:1790100297.623739:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1790100297.623771:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140878464:0@lo:700: 00000100:00100000:3.0:1790100297.623805:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.623841:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3f8aae8 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.623901:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140878464 00000100:00100000:1.0:1790100297.623906:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140878464 00000100:00100000:1.0:1790100297.623942:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100297.623950:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000990bab73 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140878464:12345-0@lo:700: 00000100:00100000:1.0:1790100297.623996:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000990bab73 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140878464:12345-0@lo:700: Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.624002:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100297.624066:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140878464:0@lo:700: 00100000:10000000:2.0:1790100297.624070:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:3.0:1790100297.624106:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7466:1877056140878592:0@lo:900: 00000100:00100000:3.0:1790100297.624143:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.624165:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3f8aae8 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.624222:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140878592 00000100:00100000:1.0:1790100297.624227:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140878592 00000100:00100000:1.0:1790100297.624293:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100297.624300:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cc1e252 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7466:x1877056140878592:12345-0@lo:900: 00000100:00100000:1.0:1790100297.624360:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cc1e252 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7466:x1877056140878592:12345-0@lo:900: Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.624372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1790100297.624477:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1790100297.624722:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1790100297.624878:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00010000:00080000:3.0:1790100297.624904:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f441d63e x1877056140878592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790100313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100297.624916:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7466:1877056140878592:0@lo:900: 00000100:00100000:3.0:1790100297.625030:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140878720:0@lo:1000: 00000100:00100000:3.0:1790100297.625066:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1790100297.625088:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:3.0:1790100297.625090:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.625156:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140878720 00000100:00100000:1.0:1790100297.625162:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140878720 00000100:00100000:1.0:1790100297.625203:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100297.625210:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f031b55d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140878720:12345-0@lo:1000: 00000100:00100000:1.0:1790100297.625657:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f031b55d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140878720:12345-0@lo:1000: Request processed in 447us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.625666:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100297.625778:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140878720:0@lo:1000: 00000004:00080000:3.0:1790100297.625816:0:7466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f3f8aae8 with version 0 00000020:00100000:3.0:1790100297.625829:0:7466:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790100297.625834:0:7466:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f441d63e x1877056140878976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790100297.625846:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140878976:0@lo:1000: 00000100:00100000:3.0:1790100297.625870:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.625893:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f72009a going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.625996:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140878976 00000100:00100000:1.0:1790100297.626002:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140878976 00000100:00100000:1.0:1790100297.626040:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100297.626049:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000491aef98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140878976:12345-0@lo:1000: 00100000:10000000:2.0:1790100297.626212:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1790100297.626408:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 40000000:02000000:0.0:1790100297.626504:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1790100297.626578:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1790100297.626735:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1790100297.626837:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1790100297.626928:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1790100297.627047:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1790100297.627576:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1790100297.627737:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1790100297.627863:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1790100297.627997:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1790100297.628492:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1790100297.628586:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1790100297.628743:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1790100297.628846:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1790100297.628924:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1790100297.629036:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1790100297.629197:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1790100297.629379:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1790100297.629509:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1790100297.629639:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1790100297.629787:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1790100297.629938:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1790100297.630064:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1790100297.630208:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1790100297.630336:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1790100297.630544:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1790100297.630731:0:7440:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1790100297.632997:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1790100297.634657:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000491aef98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140878976:12345-0@lo:1000: Request processed in 8605us (8780us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790100297.634672:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1790100297.634984:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1790100297.634994:0:7466:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790100297.635027:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140878976:0@lo:1000: 00000100:00100000:3.0:1790100297.635108:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140879104:0@lo:1000: 00000100:00100000:3.0:1790100297.635156:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100297.635204:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000005871778b going to sleep for 11 seconds 00000100:00100000:1.0:1790100297.635237:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140879104 00000100:00100000:1.0:1790100297.635245:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140879104 00000100:00100000:1.0:1790100297.635520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100297.635529:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004cdb9521 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140879104:12345-0@lo:1000: 00000100:00100000:1.0:1790100297.635683:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004cdb9521 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1877056140879104:12345-0@lo:1000: Request processed in 155us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100297.635691:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000001:00080000:1.0:1790100297.636863:0:7440:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790100297.636896:0:7440:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbae481c07988 00100000:10000000:1.0:1790100297.636904:0:7440:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:0.0:1790100297.637155:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f1e7060 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7465:x1877056140878208:12345-0@lo:700: Request processed in 19336us (19686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.637171:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:1.0:1790100297.637442:0:7440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790100297.637472:0:7440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00010000:00080000:2.0:1790100297.637492:0:7465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009a8e82cb x1877056140878208/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790100313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:1.0:1790100297.637505:0:7440:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000100:00100000:2.0:1790100297.637509:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a8e82cb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7465:1877056140878208:0@lo:700: 40000000:02000000:2.0:1790100297.637522:0:7465:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000080:00000004:1.0:1790100297.637705:0:7440:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:3.0:1790100297.641088:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1877056140879104:0@lo:1000: 00000040:00080000:3.0:1790100297.641140:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1790100297.641181:0:7466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f3f8aae8 with version 1 00000004:00080000:0.0:1790100297.645446:0:7454:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000009710af4d version 1 rpc_version 1 00000020:00100000:0.0:1790100297.645544:0:7454:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790100297.645554:0:7454:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e7c26a18 x1877056140879360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100297.645577:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7454:1877056140879360:0@lo:1000: 00000040:00080000:3.0:1790100297.645611:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1790100297.645653:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.645697:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010fb2281 going to sleep for 11 seconds 00000100:00100000:2.0:1790100297.645699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140879360 00000100:00100000:2.0:1790100297.645707:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140879360 00000100:00100000:2.0:1790100297.645763:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790100297.645772:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e6b6f0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7454:x1877056140879360:12345-0@lo:1000: 00000004:00080000:3.0:1790100297.646099:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:00000004:2.0:1790100297.647326:0:7440:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790100297.647651:0:7440:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:3.0:1790100297.652666:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1790100297.652943:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e6b6f0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7454:x1877056140879360:12345-0@lo:1000: Request processed in 7170us (7287us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790100297.652956:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1790100297.653013:0:7454:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1790100297.653018:0:7454:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790100297.653038:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7454:1877056140879360:0@lo:1000: 00000040:00080000:3.0:1790100297.660195:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100297.669008:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790100297.669080:0:7465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790100297.669085:0:7465:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 10000000:01000000:3.0:1790100298.504908:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790100298.504916:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9261b2026000 from 4 10000000:01000000:3.0:1790100298.504922:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790100298.504970:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000110dbe98/0xc87a4f2298286823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.504983:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000110dbe98/0xc87a4f2298286823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.504993:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000110dbe98/0xc87a4f2298286823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100298.505015:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140879488:0@lo:101: 00000100:00100000:3.0:1790100298.505140:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100298.505225:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140879488 00000100:00100000:2.0:1790100298.505234:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140879488 00000100:00100000:2.0:1790100298.505285:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100298.505293:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000045039bc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+13:6510:x1877056140879488:12345-0@lo:101: 00010000:00010000:2.0:1790100298.505305:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100298.505318:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082bc7212/0xc87a4f229828682a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286823 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.505366:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082bc7212/0xc87a4f229828682a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286823 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.505379:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082bc7212/0xc87a4f229828682a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286823 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.505387:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082bc7212, rc 0) 00000100:00100000:3.0:1790100298.505417:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003249b0c8 going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.505428:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000045039bc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140879488:12345-0@lo:101: Request processed in 135us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.505436:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790100298.505442:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140879488:0@lo:101: 00010000:00010000:3.0:1790100298.505456:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000110dbe98/0xc87a4f2298286823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.505466:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000110dbe98/0xc87a4f2298286823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100298.505515:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140879616:0@lo:256: 00000100:00100000:3.0:1790100298.505545:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100298.505597:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140879616 00000100:00100000:2.0:1790100298.505601:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140879616 00000100:00100000:2.0:1790100298.505631:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100298.505638:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002867f6f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140879616:12345-0@lo:256: 00000100:00100000:3.0:1790100298.505702:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003249b0c8 going to sleep for 11 seconds 20000000:01000000:2.0:1790100298.505715:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790100298.505735:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790100298.505739:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1790100298.505817:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002867f6f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140879616:12345-0@lo:256: Request processed in 180us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.505824:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790100298.506003:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140879616:0@lo:256: 10000000:01000000:3.0:1790100298.506041:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790100298.506047:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000110dbe98/0xc87a4f2298286823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.506055:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000110dbe98/0xc87a4f2298286823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100298.506063:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790100298.506065:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926187007800 from 21 10000000:01000000:3.0:1790100298.506067:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790100298.506082:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f2298286831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.506088:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f2298286831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.506095:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f2298286831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100298.506212:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140879744:0@lo:101: 00000100:00100000:3.0:1790100298.506237:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.506292:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003249b0c8 going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.506330:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140879744 00000100:00100000:2.0:1790100298.506334:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140879744 00000100:00100000:2.0:1790100298.506461:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790100298.506468:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c3b5cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140879744:12345-0@lo:101: 00010000:00010000:2.0:1790100298.506476:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100298.506483:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c37c330/0xc87a4f2298286838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286831 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.506499:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c37c330/0xc87a4f2298286838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286831 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.506506:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c37c330/0xc87a4f2298286838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286831 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.506513:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c37c330, rc 0) 00000100:00100000:2.0:1790100298.506550:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c3b5cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140879744:12345-0@lo:101: Request processed in 82us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.506556:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790100298.506610:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140879744:0@lo:101: 00010000:00010000:3.0:1790100298.506619:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f2298286831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.506626:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f2298286831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100298.506675:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140879872:0@lo:501: 00000100:00100000:3.0:1790100298.506698:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.506835:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003249b0c8 going to sleep for 11 seconds 00000100:00100000:0.0:1790100298.507077:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140879872 00000100:00100000:0.0:1790100298.507082:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140879872 00000100:00100000:0.0:1790100298.507109:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790100298.507128:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006c6fe09c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140879872:12345-0@lo:501: 00000100:00100000:0.0:1790100298.507249:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006c6fe09c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140879872:12345-0@lo:501: Request processed in 134us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100298.507255:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100298.507373:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140879872:0@lo:501: 00000100:00100000:3.0:1790100298.507396:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880000:0@lo:503: 00000100:00100000:3.0:1790100298.507427:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.507450:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003249b0c8 going to sleep for 11 seconds 00000100:00100000:0.0:1790100298.507499:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140880000 00000100:00100000:0.0:1790100298.507503:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140880000 00000100:00100000:0.0:1790100298.507518:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790100298.507522:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000818b64d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140880000:12345-0@lo:503: 00000100:00100000:0.0:1790100298.507599:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000818b64d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140880000:12345-0@lo:503: Request processed in 76us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100298.507606:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790100298.507674:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880000:0@lo:503: 00000100:00100000:3.0:1790100298.508179:0:7537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:7537:1877056140880128:0@lo:502: 00000100:00100000:3.0:1790100298.508214:0:7537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.508268:0:7537:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:1.0:1790100298.508277:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140880128 00000100:00100000:1.0:1790100298.508283:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140880128 00000100:00100000:0.0:1790100298.508470:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790100298.508479:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000033e504f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:7537:x1877056140880128:12345-0@lo:502: 00000100:00100000:0.0:1790100298.508600:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000033e504f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:7537:x1877056140880128:12345-0@lo:502: Request processed in 123us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100298.508607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790100298.508669:0:7537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:7537:1877056140880128:0@lo:502: 00000100:00100000:3.0:1790100298.508706:0:7537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:7537:1877056140880256:0@lo:502: 00000100:00100000:3.0:1790100298.508743:0:7537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.508807:0:7537:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:1.0:1790100298.508839:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140880256 00000100:00100000:1.0:1790100298.508844:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140880256 00000100:00100000:1.0:1790100298.508873:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790100298.508879:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000095249501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:7537:x1877056140880256:12345-0@lo:502: 00000100:00100000:1.0:1790100298.508990:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000095249501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:7537:x1877056140880256:12345-0@lo:502: Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100298.508997:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100298.509052:0:7537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:7537:1877056140880256:0@lo:502: 00000040:00080000:3.0:1790100298.509068:0:7537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1790100298.509265:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1790100298.509284:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790100298.509290:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f2298286831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.509299:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000025784de1/0xc87a4f2298286831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100298.509318:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790100298.509320:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926187007800 from 4 10000000:01000000:2.0:1790100298.509322:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790100298.509486:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000022445466/0xc87a4f229828683f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.509494:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000022445466/0xc87a4f229828683f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.509501:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000022445466/0xc87a4f229828683f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100298.509513:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a8e82cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880384:0@lo:101: 00000100:00100000:2.0:1790100298.509539:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100298.509599:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c657622 going to sleep for 11 seconds 00000100:00100000:0.0:1790100298.509633:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140880384 00000100:00100000:0.0:1790100298.509637:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140880384 00000100:00100000:0.0:1790100298.509697:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790100298.509703:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3190102 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140880384:12345-0@lo:101: 00010000:00010000:0.0:1790100298.509710:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100298.509719:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dabfad21/0xc87a4f2298286846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828683f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100298.509737:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dabfad21/0xc87a4f2298286846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828683f expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100298.509746:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dabfad21/0xc87a4f2298286846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828683f expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100298.509760:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dabfad21, rc 0) 00000100:00100000:0.0:1790100298.509795:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3190102 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140880384:12345-0@lo:101: Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100298.509800:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790100298.509857:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a8e82cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880384:0@lo:101: 00010000:00010000:3.0:1790100298.509869:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000022445466/0xc87a4f229828683f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.509876:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000022445466/0xc87a4f229828683f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100298.509913:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880512:0@lo:256: 00000100:00100000:3.0:1790100298.509939:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.510134:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.510236:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140880512 00000100:00100000:2.0:1790100298.510241:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140880512 00000100:00100000:2.0:1790100298.510260:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790100298.510266:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c00a224 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140880512:12345-0@lo:256: 20000000:01000000:2.0:1790100298.510278:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790100298.510295:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790100298.510297:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1790100298.510400:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c00a224 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140880512:12345-0@lo:256: Request processed in 134us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.510406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790100298.510496:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880512:0@lo:256: 10000000:01000000:3.0:1790100298.510534:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790100298.510539:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000022445466/0xc87a4f229828683f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.510546:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000022445466/0xc87a4f229828683f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100298.510553:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790100298.510555:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790100298.510561:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790100298.510576:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000348d0602/0xc87a4f229828684d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.510592:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000348d0602/0xc87a4f229828684d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.510599:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000348d0602/0xc87a4f229828684d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100298.510610:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880640:0@lo:101: 00000100:00100000:3.0:1790100298.510632:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.510647:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.510689:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140880640 00000100:00100000:2.0:1790100298.510693:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140880640 00000100:00100000:2.0:1790100298.510709:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790100298.510719:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087d8fd09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140880640:12345-0@lo:101: 00010000:00010000:2.0:1790100298.510726:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100298.510734:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e37d4084/0xc87a4f2298286854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828684d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.510748:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e37d4084/0xc87a4f2298286854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828684d expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.510756:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e37d4084/0xc87a4f2298286854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828684d expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100298.510763:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e37d4084, rc 0) 00000100:00100000:2.0:1790100298.510798:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087d8fd09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140880640:12345-0@lo:101: Request processed in 79us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.510803:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790100298.510866:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880640:0@lo:101: 00010000:00010000:3.0:1790100298.510874:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000348d0602/0xc87a4f229828684d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100298.510881:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000348d0602/0xc87a4f229828684d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100298.510921:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880768:0@lo:501: 00000100:00100000:3.0:1790100298.510944:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.510963:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.511007:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140880768 00000100:00100000:2.0:1790100298.511012:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140880768 00000100:00100000:2.0:1790100298.511029:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790100298.511035:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f0403057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140880768:12345-0@lo:501: 00000100:00100000:2.0:1790100298.511144:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f0403057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140880768:12345-0@lo:501: Request processed in 109us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.511150:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790100298.511210:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880768:0@lo:501: 00000100:00100000:3.0:1790100298.511232:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880896:0@lo:503: 00000100:00100000:3.0:1790100298.511266:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.511287:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5add96 going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.511329:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140880896 00000100:00100000:2.0:1790100298.511333:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140880896 00000100:00100000:2.0:1790100298.511376:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790100298.511381:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058f04908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140880896:12345-0@lo:503: 00000100:00100000:2.0:1790100298.511452:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058f04908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140880896:12345-0@lo:503: Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.511466:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790100298.511557:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140880896:0@lo:503: 00000100:00100000:3.0:1790100298.511903:0:7538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:7538:1877056140881024:0@lo:502: 00000100:00100000:3.0:1790100298.511939:0:7538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.511966:0:7538:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98cabf0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.512010:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140881024 00000100:00100000:2.0:1790100298.512014:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140881024 00000100:00100000:2.0:1790100298.512043:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790100298.512048:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000291c3297 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:7538:x1877056140881024:12345-0@lo:502: 00000100:00100000:2.0:1790100298.512129:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000291c3297 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:7538:x1877056140881024:12345-0@lo:502: Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.512136:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790100298.512205:0:7538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f441d63e pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:7538:1877056140881024:0@lo:502: 00000020:01000000:3.0:1790100298.512225:0:7538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100298.512234:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100298.512236:0:7538:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790100298.512241:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790100298.512244:0:7538:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:00000080:3.0:1790100298.512264:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790100298.512278:0:7538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000007c0f5458) 00000020:00000080:3.0:1790100298.512297:0:7538:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1790100298.512302:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790100298.512415:0:7538:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790100298.512420:0:7538:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790100298.512428:0:7538:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298286862 00010000:00080000:3.0:1790100298.512454:0:7538:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000443f68b9@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1790100298.514060:0:7538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1790100298.514766:0:7538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790100298.514776:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790100298.514807:0:7538:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790100298.514826:0:7538:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298286869 00000100:00080000:2.0:1790100298.514835:0:7538:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790100298.514844:0:7538:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000443f68b9 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100298.514873:0:7538:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000042f9b1a2 x1877056140881152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100298.514897:0:7538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790100298.514965:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c91e868b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140881536:0@lo:400: 00000100:00100000:2.0:1790100298.515018:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100298.515047:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100298.515053:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063639c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140881408:0@lo:400: 00000100:00100000:2.0:1790100298.515079:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1790100298.515129:0:7538:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1790100298.515599:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042f9b1a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056140881152:0@lo:38: 00000100:00100000:1.0:1790100298.515632:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100298.515679:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140881408 00000100:00100000:1.0:1790100298.515685:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140881408 00000100:00100000:1.0:1790100298.515712:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140881152 00000100:00100000:1.0:1790100298.515714:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140881152 00000100:00100000:1.0:1790100298.515725:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100298.515731:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089c8c918 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140881408:12345-0@lo:400: 00000100:00100000:1.0:1790100298.515779:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089c8c918 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140881408:12345-0@lo:400: Request processed in 49us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100298.515785:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100298.515806:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100298.515810:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d87e8c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877056140881152:12345-0@lo:38: 00010000:00080000:1.0:1790100298.515829:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:1.0:1790100298.515858:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298286870 00000004:00100000:1.0:1790100298.515870:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790100298.515875:0:6518:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1790100298.516016:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063639c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140881408:0@lo:400: 00000100:00100000:3.0:1790100298.516223:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007988d67a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140881280:0@lo:400: 00000100:00100000:3.0:1790100298.516250:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.516280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140881536 00000100:00100000:3.0:1790100298.516283:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140881536 00000100:00100000:3.0:1790100298.516304:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140881280 00000100:00100000:3.0:1790100298.516306:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140881280 00000100:00100000:3.0:1790100298.516316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100298.516321:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e29cc045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140881536:12345-0@lo:400: 00000100:00100000:3.0:1790100298.516367:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e29cc045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140881536:12345-0@lo:400: Request processed in 45us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100298.516373:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100298.516384:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100298.516397:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f441d63e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140881280:12345-0@lo:400: 00000100:00100000:3.0:1790100298.516426:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f441d63e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140881280:12345-0@lo:400: Request processed in 30us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100298.516432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790100298.516458:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007988d67a x1877056140881280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100298.516468:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007988d67a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140881280:0@lo:400: 00010000:00080000:3.0:1790100298.516486:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c91e868b x1877056140881536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100298.516495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c91e868b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140881536:0@lo:400: 00000100:00080000:1.0:1790100298.516664:0:7541:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000193fab7f x1877056140881664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100298.516672:0:7541:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef1da264 going to sleep for 0 seconds 00000020:01000000:2.0:1790100298.516793:0:7538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100298.516799:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100298.516801:0:7538:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1790100298.516804:0:7538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100298.516814:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100298.516815:0:7538:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790100298.516818:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790100298.516820:0:7538:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790100298.516837:0:7538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009aae84b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:7538:1877056140881792:0@lo:502: 00000100:00100000:2.0:1790100298.516876:0:7538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100298.516934:0:7538:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b54f28cb going to sleep for 11 seconds 00000100:00100000:3.0:1790100298.516969:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140881792 00000100:00100000:3.0:1790100298.516974:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140881792 00000100:00100000:3.0:1790100298.517040:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790100298.517047:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005db01e59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:7538:x1877056140881792:12345-0@lo:502: 00000100:00100000:3.0:1790100298.517153:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005db01e59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:7538:x1877056140881792:12345-0@lo:502: Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100298.517159:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790100298.517227:0:7538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009aae84b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:7538:1877056140881792:0@lo:502: 00000020:01000000:2.0:1790100298.517245:0:7538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100298.517249:0:7538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100298.517250:0:7538:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790100298.517253:0:7538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1790100298.517403:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1790100298.517421:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790100298.517428:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000348d0602/0xc87a4f229828684d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100298.517437:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000348d0602/0xc87a4f229828684d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100298.517447:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790100298.517449:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9261b2304d40 from 1 10000000:01000000:1.0:1790100298.517451:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790100298.517470:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000236ae7cd/0xc87a4f2298286877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100298.517478:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000236ae7cd/0xc87a4f2298286877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100298.517485:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000236ae7cd/0xc87a4f2298286877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100298.517504:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067edc20c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140881920:0@lo:101: 00000100:00100000:1.0:1790100298.517528:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100298.517660:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d59a435f going to sleep for 11 seconds 00000100:00100000:0.0:1790100298.517716:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140881920 00000100:00100000:0.0:1790100298.517720:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140881920 00000100:00100000:0.0:1790100298.517740:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790100298.517745:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005a69db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140881920:12345-0@lo:101: 00010000:00010000:0.0:1790100298.517752:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100298.517761:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086420aa9/0xc87a4f229828687e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286877 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100298.517778:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086420aa9/0xc87a4f229828687e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286877 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100298.517786:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086420aa9/0xc87a4f229828687e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286877 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100298.517793:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086420aa9, rc 0) 00000100:00100000:0.0:1790100298.517825:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005a69db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140881920:12345-0@lo:101: Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100298.517830:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790100298.517891:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067edc20c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140881920:0@lo:101: 00010000:00010000:1.0:1790100298.517901:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000236ae7cd/0xc87a4f2298286877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100298.517908:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000236ae7cd/0xc87a4f2298286877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100298.517953:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067edc20c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140882048:0@lo:501: 00000100:00100000:1.0:1790100298.517976:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100298.517995:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d59a435f going to sleep for 11 seconds 00000100:00100000:0.0:1790100298.518044:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140882048 00000100:00100000:0.0:1790100298.518048:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140882048 00000100:00100000:0.0:1790100298.518063:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790100298.518068:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1f578ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140882048:12345-0@lo:501: 00000100:00100000:0.0:1790100298.518148:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1f578ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140882048:12345-0@lo:501: Request processed in 79us (171us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100298.518154:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790100298.518219:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067edc20c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140882048:0@lo:501: 10000000:01000000:1.0:1790100298.518243:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790100298.518247:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000236ae7cd/0xc87a4f2298286877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100298.518254:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000236ae7cd/0xc87a4f2298286877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790100298.522767:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000dd914672 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100298.522860:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d87e8c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1877056140881152:12345-0@lo:38: Request processed in 7047us (7227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100298.522871:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100298.523076:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790100298.523085:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790100298.523093:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790100298.523099:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790100298.523100:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000443f68b9 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790100298.523165:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ef1da264): req@00000000193fab7f x1877056140881664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100298.523185:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042f9b1a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056140881152:0@lo:38: 00000100:00100000:1.0:1790100298.524064:0:7541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100298.524123:0:7541:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef1da264 going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.524175:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140881664 00000100:00100000:2.0:1790100298.524181:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140881664 00000100:00100000:2.0:1790100298.524225:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790100298.524233:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067edc20c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140881664:12345-0@lo:1000: 00000100:00100000:2.0:1790100298.524307:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067edc20c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140881664:12345-0@lo:1000: Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.524313:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100298.524521:0:7541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000193fab7f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140881664:0@lo:1000: 00000040:01000000:3.0:1790100298.524553:0:7541:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790100298.524588:0:7541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0301192 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882176:0@lo:1000: 00000100:00100000:3.0:1790100298.524618:0:7541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.524646:0:7541:0:(client.c:2716:ptlrpc_set_wait()) set 000000005871778b going to sleep for 11 seconds 00000100:00100000:2.0:1790100298.524685:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140882176 00000100:00100000:2.0:1790100298.524695:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140882176 00000100:00100000:2.0:1790100298.524715:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100298.524720:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6234fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140882176:12345-0@lo:1000: 00000100:00100000:2.0:1790100298.524815:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6234fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140882176:12345-0@lo:1000: Request processed in 94us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100298.524821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100298.524944:0:7541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0301192 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882176:0@lo:1000: 00000100:00100000:3.0:1790100298.524979:0:7541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0301192 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882304:0@lo:700: 00000100:00100000:3.0:1790100298.525010:0:7541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.525031:0:7541:0:(client.c:2716:ptlrpc_set_wait()) set 000000003249b0c8 going to sleep for 11 seconds 00000100:00100000:1.0:1790100298.525081:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140882304 00000100:00100000:1.0:1790100298.525086:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140882304 00000100:00100000:1.0:1790100298.525126:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100298.525132:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000126083ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140882304:12345-0@lo:700: 00000100:00100000:1.0:1790100298.525181:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000126083ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140882304:12345-0@lo:700: Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100298.525187:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100298.525290:0:7541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0301192 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882304:0@lo:700: 00000100:00100000:2.0:1790100298.525469:0:7541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042f9b1a2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882432:0@lo:1000: 00000100:00100000:2.0:1790100298.525493:0:7541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100298.525515:0:7541:0:(client.c:2716:ptlrpc_set_wait()) set 000000009db20fdd going to sleep for 11 seconds 00000100:00100000:1.0:1790100298.525603:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140882432 00000100:00100000:1.0:1790100298.525608:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140882432 00000100:00100000:1.0:1790100298.525640:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100298.525646:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009aae84b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140882432:12345-0@lo:1000: 00000100:00100000:1.0:1790100298.525703:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009aae84b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140882432:12345-0@lo:1000: Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100298.525710:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100298.525789:0:7541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042f9b1a2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882432:0@lo:1000: 00000004:00080000:3.0:1790100298.525827:0:7541:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b54f28cb with version 0 00000020:00100000:3.0:1790100298.525840:0:7541:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790100298.525845:0:7541:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b0301192 x1877056140882688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790100298.525858:0:7541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0301192 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882688:0@lo:1000: 00000100:00100000:3.0:1790100298.525880:0:7541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100298.525901:0:7541:0:(client.c:2716:ptlrpc_set_wait()) set 000000005871778b going to sleep for 11 seconds 00000100:00100000:1.0:1790100298.526028:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140882688 00000100:00100000:1.0:1790100298.526032:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140882688 00000100:00100000:1.0:1790100298.526153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100298.526160:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f65163 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7541:x1877056140882688:12345-0@lo:1000: 00000100:00100000:3.0:1790100298.526934:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000713eb74a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140882816:0@lo:41: 00000100:00100000:3.0:1790100298.526966:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100298.527138:0:6518:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000001:00080000:1.0:1790100298.528750:0:7441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1790100298.528760:0:7441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790100298.528960:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f65163 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7541:x1877056140882688:12345-0@lo:1000: Request processed in 2800us (3077us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790100298.528971:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1790100298.529041:0:7541:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1790100298.529046:0:7541:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790100298.529066:0:7541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0301192 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882688:0@lo:1000: 00000100:00100000:0.0:1790100298.529149:0:7541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c35beba4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882944:0@lo:1000: 00000100:00100000:0.0:1790100298.529181:0:7541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100298.529240:0:6518:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1790100298.529480:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140882816 00000100:00100000:1.0:1790100298.529487:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140882816 00000100:00100000:1.0:1790100298.529521:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100298.529527:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000032c30aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140882816:12345-0@lo:41: 00000004:00000024:1.0:1790100298.529553:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790100298.529593:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000032c30aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140882816:12345-0@lo:41: Request processed in 66us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100298.529619:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100298.529653:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000713eb74a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140882816:0@lo:41: 00000100:00100000:3.0:1790100298.531164:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140882944 00000100:00100000:0.0:1790100298.531164:0:7541:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020dd6e09 going to sleep for 11 seconds 00000100:00100000:3.0:1790100298.531173:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140882944 00000100:00100000:3.0:1790100298.531210:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100298.531219:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000850cb901 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7541:x1877056140882944:12345-0@lo:1000: 00000100:00100000:3.0:1790100298.531295:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000850cb901 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7541:x1877056140882944:12345-0@lo:1000: Request processed in 78us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100298.531302:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790100298.531446:0:7541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c35beba4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7541:1877056140882944:0@lo:1000: 00000040:00080000:0.0:1790100298.531620:0:7541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1790100298.531738:0:7541:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000dc96f7aa with version 1 00000004:00080000:1.0:1790100298.532415:0:7539:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000027d75cfd version 1 rpc_version 1 00000020:00100000:1.0:1790100298.532439:0:7539:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790100298.532446:0:7539:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000079f9f774 x1877056140883200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100298.532464:0:7539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079f9f774 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7539:1877056140883200:0@lo:1000: 00000100:00100000:1.0:1790100298.532502:0:7539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100298.532560:0:7539:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d59a435f going to sleep for 11 seconds 00000100:00100000:3.0:1790100298.533833:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140883200 00000100:00100000:3.0:1790100298.533842:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140883200 00000100:00100000:3.0:1790100298.533885:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790100298.533893:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b4626c38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7539:x1877056140883200:12345-0@lo:1000: 00000040:00080000:0.0:1790100298.535274:0:7541:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790100298.535507:0:7541:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790100298.535512:0:7541:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1790100298.543870:0:7441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1790100298.544111:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b4626c38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7539:x1877056140883200:12345-0@lo:1000: Request processed in 10215us (11604us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790100298.544133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1790100298.544207:0:7539:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1790100298.544316:0:7539:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790100298.544334:0:7539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079f9f774 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7539:1877056140883200:0@lo:1000: 00010000:00010000:3.0:1790100298.568713:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100299.595055:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790100300.418220:0:7717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790100300.616492:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790100301.007065:0:7769:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790100301.007542:0:7769:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790100301.640440:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100302.669247:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100302.793771:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f041fbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140883328:0@lo:41: 00000100:00100000:3.0:1790100302.793841:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100302.793911:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140883328 00000100:00100000:3.0:1790100302.793919:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140883328 00000100:00100000:3.0:1790100302.793961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790100302.793969:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc55a267 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140883328:12345-0@lo:41: 00000004:00000024:3.0:1790100302.794001:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1790100302.795158:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc55a267 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140883328:12345-0@lo:41: Request processed in 1186us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100302.795170:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790100302.795231:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f041fbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140883328:0@lo:41: 00000020:00000004:1.0:1790100303.239881:0:7870:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100303.240056:0:7870:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100303.693218:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100303.816584:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d83c2d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140883712:0@lo:400: 00000100:00100000:1.0:1790100303.816584:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079f9f774 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140883456:0@lo:400: 00000100:00100000:2.0:1790100303.816669:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100303.816670:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100303.816738:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100303.816740:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018db7593 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140883968:0@lo:400: 00000100:00100000:2.0:1790100303.816748:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000193fab7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140883840:0@lo:400: 00000100:00100000:3.0:1790100303.816758:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140883712 00000100:00100000:3.0:1790100303.816766:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140883712 00000100:00100000:1.0:1790100303.816774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100303.816788:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100303.816802:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790100303.816812:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007426e7ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140883584:0@lo:400: 00000100:00100000:1.0:1790100303.816838:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100303.816859:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c35beba4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140884096:0@lo:41: 00000100:00100000:1.0:1790100303.816879:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100303.816888:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140883840 00000100:00100000:2.0:1790100303.816895:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140883840 00000100:00100000:3.0:1790100303.816908:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140883968 00000100:00100000:3.0:1790100303.816914:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140883968 00000100:00100000:1.0:1790100303.816931:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140883456 00000100:00100000:2.0:1790100303.816937:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140883584 00000100:00100000:1.0:1790100303.816938:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140883456 00000100:00100000:3.0:1790100303.816939:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140884096 00000100:00100000:2.0:1790100303.816944:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140883584 00000100:00100000:3.0:1790100303.816945:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140884096 00000100:00100000:3.0:1790100303.816984:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100303.816985:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790100303.816994:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e782cd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140883712:12345-0@lo:400: 00000100:00100000:1.0:1790100303.816997:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000507f9640 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:3643:x1877056140883456:12345-0@lo:400: 00000100:00100000:2.0:1790100303.817048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100303.817054:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000507f9640 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:3643:x1877056140883456:12345-0@lo:400: Request processed in 60us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100303.817062:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065cd66c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140883840:12345-0@lo:400: 00000100:00100000:3.0:1790100303.817063:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e782cd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140883712:12345-0@lo:400: Request processed in 69us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100303.817066:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790100303.817085:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790100303.817113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790100303.817121:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005bf799c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140883968:12345-0@lo:400: 00000100:00100000:1.0:1790100303.817126:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100303.817129:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065cd66c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140883840:12345-0@lo:400: Request processed in 71us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100303.817139:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e37cef7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140884096:12345-0@lo:41: 00000100:00100000:2.0:1790100303.817153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00000024:1.0:1790100303.817167:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1790100303.817172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100303.817181:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000968c32b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140883584:12345-0@lo:400: 00000100:00100000:1.0:1790100303.817205:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e37cef7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140884096:12345-0@lo:41: Request processed in 70us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100303.817214:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100303.817225:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000968c32b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140883584:12345-0@lo:400: Request processed in 45us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100303.817233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790100303.817316:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007426e7ac x1877056140883584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100303.817329:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007426e7ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140883584:0@lo:400: 00010000:00080000:0.0:1790100303.817446:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000193fab7f x1877056140883840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100303.817459:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005bf799c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140883968:12345-0@lo:400: Request processed in 338us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100303.817459:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000193fab7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140883840:0@lo:400: 00000100:00100000:3.0:1790100303.817472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100303.817479:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d83c2d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140883712:0@lo:400: 00000100:00100000:1.0:1790100303.817543:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c35beba4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140884096:0@lo:41: 00000100:00100000:1.0:1790100303.817554:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079f9f774 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140883456:0@lo:400: 00000100:00100000:1.0:1790100303.817562:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018db7593 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140883968:0@lo:400: 00000020:00000080:0.0:1790100303.976062:0:7918:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda0306a50 20000000:00000080:0.0:1790100303.976087:0:7918:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9261a6127800 uarg=0000000000000000 20000000:01000000:0.0:1790100303.976124:0:7918:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790100303.976132:0:7918:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790100303.976142:0:7918:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790100303.976216:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1790100303.976228:0:7918:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1790100303.978844:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100303.979130:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790100303.979161:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1790100303.979177:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1790100303.979195:0:7918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790100303.979211:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100303.979225:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982866fd expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100303.979229:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982867eb expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100303.979234:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100303.979263:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982867eb expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100303.979333:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982867eb expref: 17 pid: 6505 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100303.979436:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c35beba4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1877056140884224:0@lo:104: 00000100:00100000:0.0:1790100303.979504:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100303.979565:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982866fd expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100303.979572:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982866fd expref: 17 pid: 6506 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100303.979586:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000713eb74a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1877056140884352:0@lo:104: 00000100:00100000:0.0:1790100303.979606:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1e4f894 going to sleep for 11 seconds 00000100:00100000:3.0:1790100303.979620:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790100303.979642:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100303.979673:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140884224 00000100:00100000:3.0:1790100303.979682:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140884224 00000100:00100000:0.0:1790100303.979682:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140884352 00000100:00100000:0.0:1790100303.979690:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140884352 00000100:00100000:3.0:1790100303.979726:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100303.979736:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000435f3adb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+4:7918:x1877056140884224:12345-0@lo:104: 00010000:00010000:3.0:1790100303.979748:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.979811:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100303.979816:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000435f3adb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+4:7918:x1877056140884224:12345-0@lo:104: Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100303.979823:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100303.979827:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c35beba4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1877056140884224:0@lo:104: 00000100:00100000:3.0:1790100303.979864:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100303.979872:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f041fbe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:7918:x1877056140884352:12345-0@lo:104: 00010000:00010000:3.0:1790100303.979879:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.979923:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100303.979927:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f041fbe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:7918:x1877056140884352:12345-0@lo:104: Request processed in 58us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100303.979933:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1790100303.979950:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100303.979960:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.979967:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a500c9f0 already unused, calling callback (00000000826b2a0f) 10000000:00010000:3.0:1790100303.979971:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.979978:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100303.979985:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000713eb74a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1877056140884352:0@lo:104: 10000000:00010000:3.0:1790100303.979998:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100303.980003:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100303.980006:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100303.980177:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980184:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100303.980204:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100303.980211:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000634b4507 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140884480:0@lo:103: 00010000:00010000:3.0:1790100303.980213:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000a500c9f0/0xc87a4f22982867eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982867f2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980228:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100303.980230:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980236:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c056a28d already unused, calling callback (00000000826b2a0f) 10000000:00010000:3.0:1790100303.980238:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100303.980246:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100303.980265:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100303.980271:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100303.980276:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100303.980294:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980299:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100303.980309:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980315:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000c056a28d/0xc87a4f22982866fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286704 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980329:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100303.980332:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100303.980333:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100303.980365:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140884480 00000100:00100000:3.0:1790100303.980370:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140884480 00000100:00100000:0.0:1790100303.980380:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1790100303.980390:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982867eb expref: 18 pid: 6505 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100303.980390:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000072b89a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140884608:0@lo:103: 00000100:00100000:3.0:1790100303.980415:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100303.980422:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000713eb74a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+18:3641:x1877056140884480:12345-0@lo:103: 00010000:00010000:3.0:1790100303.980432:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100303.980435:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982867eb expref: 18 pid: 6505 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980451:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982867eb expref: 18 pid: 6505 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980464:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e15baf8d/0xc87a4f22982867f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982867eb expref: 18 pid: 6505 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980474:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100303.980499:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000713eb74a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+17:3641:x1877056140884480:12345-0@lo:103: Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100303.980505:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100303.980543:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100303.980570:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140884608 00000100:00100000:3.0:1790100303.980575:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140884608 00000100:00100000:0.0:1790100303.980583:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000634b4507 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140884480:0@lo:103: 00010000:00010000:3.0:1790100303.980588:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982866fd expref: 17 pid: 6506 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100303.980609:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100303.980616:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c35beba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+17:3641:x1877056140884608:12345-0@lo:103: 00010000:00010000:3.0:1790100303.980623:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100303.980626:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982866fd expref: 17 pid: 6506 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980633:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982866fd expref: 17 pid: 6506 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980641:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007487ac98/0xc87a4f2298286704 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982866fd expref: 17 pid: 6506 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980650:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980667:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980681:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980687:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980693:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980698:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980702:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a4c4e94 already unused, calling callback (00000000d6f996eb) 00010000:00010000:3.0:1790100303.980705:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980711:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980729:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100303.980738:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100303.980771:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c35beba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+16:3641:x1877056140884608:12345-0@lo:103: Request processed in 157us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100303.980777:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1790100303.980932:0:7918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100303.980940:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100303.980944:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000072b89a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140884608:0@lo:103: 00010000:00010000:0.0:1790100303.980946:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a4c4e94/0xc87a4f2298286885 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100303.981099:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100304.713430:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100305.736466:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100306.762105:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100307.785497:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100307.920936:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140884736:0@lo:41: 00000100:00100000:3.0:1790100307.921314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100307.927430:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140884736 00000100:00100000:3.0:1790100307.927442:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140884736 00000100:00100000:3.0:1790100307.927493:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790100307.927500:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d150659f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140884736:12345-0@lo:41: 00000004:00000024:3.0:1790100307.927533:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1790100307.927608:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d150659f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140884736:12345-0@lo:41: Request processed in 109us (6294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100307.927615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790100307.927670:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e2404ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140884736:0@lo:41: 10000000:01000000:0.0:1790100308.425524:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100308.425531:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b2026000 from 1 10000000:01000000:0.0:1790100308.425535:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100308.425579:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000004701a999/0xc87a4f229828688c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100308.425591:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000004701a999/0xc87a4f229828688c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100308.425601:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000004701a999/0xc87a4f229828688c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100308.425623:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140884864:0@lo:101: 00000100:00100000:0.0:1790100308.425685:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100308.425726:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000687c13cb going to sleep for 11 seconds 00000100:00100000:2.0:1790100308.426132:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140884864 00000100:00100000:2.0:1790100308.426141:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140884864 00000100:00100000:2.0:1790100308.426199:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790100308.426207:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d77f8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140884864:12345-0@lo:101: 00010000:00010000:2.0:1790100308.426220:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100308.426231:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8979bc3/0xc87a4f2298286893 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828688c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100308.426252:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8979bc3/0xc87a4f2298286893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828688c expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100308.426261:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8979bc3/0xc87a4f2298286893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828688c expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100308.426269:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8979bc3, rc 0) 00000100:00100000:2.0:1790100308.426309:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d77f8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140884864:12345-0@lo:101: Request processed in 103us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100308.426315:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100308.426698:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140884864:0@lo:101: 00010000:00010000:0.0:1790100308.426713:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000004701a999/0xc87a4f229828688c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100308.426721:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000004701a999/0xc87a4f229828688c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100308.426777:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140884992:0@lo:501: 00000100:00100000:0.0:1790100308.426806:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100308.429142:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000687c13cb going to sleep for 11 seconds 00000100:00100000:1.0:1790100308.429553:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140884992 00000100:00100000:1.0:1790100308.429563:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140884992 00000100:00100000:1.0:1790100308.429608:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790100308.429616:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003288d5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140884992:12345-0@lo:501: 00000100:00100000:1.0:1790100308.429851:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003288d5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140884992:12345-0@lo:501: Request processed in 236us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.429858:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790100308.431790:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7c26a18 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140884992:0@lo:501: 00000100:00100000:2.0:1790100308.432654:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000914dab4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140885120:0@lo:503: 00000100:00100000:2.0:1790100308.432725:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100308.432799:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038ddf9ac going to sleep for 11 seconds 00000100:00100000:1.0:1790100308.439904:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140885120 00000100:00100000:1.0:1790100308.439918:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140885120 00000100:00100000:1.0:1790100308.439968:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790100308.439976:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ba24a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140885120:12345-0@lo:503: 00000100:00100000:1.0:1790100308.440317:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ba24a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140885120:12345-0@lo:503: Request processed in 342us (7592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.440325:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790100308.440413:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000914dab4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140885120:0@lo:503: 00000100:00100000:1.0:1790100308.440623:0:8252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018db7593 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8252:1877056140885248:0@lo:502: 00000100:00100000:1.0:1790100308.440663:0:8252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.440686:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140885248 00000100:00100000:1.0:1790100308.440690:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140885248 00000100:00100000:1.0:1790100308.440711:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790100308.440717:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c520a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:8252:x1877056140885248:12345-0@lo:502: 00000100:00100000:1.0:1790100308.440782:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c520a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:8252:x1877056140885248:12345-0@lo:502: Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.440789:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790100308.440826:0:8252:0:(client.c:2716:ptlrpc_set_wait()) set 00000000516a7bee going to sleep for 11 seconds 00000100:00100000:1.0:1790100308.440839:0:8252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018db7593 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8252:1877056140885248:0@lo:502: 00000020:01000000:1.0:1790100308.440860:0:8252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100308.440869:0:8252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100308.440872:0:8252:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790100308.440883:0:8252:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261b2026000 00000020:00000080:1.0:1790100308.440890:0:8252:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790100308.440927:0:8252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8252:1877056140885376:0@lo:502: 00000100:00100000:1.0:1790100308.440958:0:8252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.440977:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140885376 00000100:00100000:1.0:1790100308.442277:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140885376 00000100:00100000:1.0:1790100308.442326:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790100308.442334:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:8252:x1877056140885376:12345-0@lo:502: 00000100:00100000:1.0:1790100308.442449:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:8252:x1877056140885376:12345-0@lo:502: Request processed in 116us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.442457:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790100308.442498:0:8252:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100308.442516:0:8252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8252:1877056140885376:0@lo:502: 00000020:01000000:1.0:1790100308.442540:0:8252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100308.442546:0:8252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100308.442548:0:8252:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790100308.442555:0:8252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790100308.442616:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790100308.442635:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100308.442644:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.442656:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100308.442666:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100308.442668:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926187007800 from 1 10000000:01000000:1.0:1790100308.442671:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100308.442695:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.442715:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.442725:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100308.442740:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140885504:0@lo:101: 00000100:00100000:1.0:1790100308.442770:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.442785:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100308.442798:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140885504 00000100:00100000:1.0:1790100308.442801:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140885504 00000100:00100000:1.0:1790100308.442822:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790100308.442828:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140885504:12345-0@lo:101: 00010000:00010000:1.0:1790100308.442837:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100308.442847:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828689a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.442868:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828689a expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.442878:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828689a expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.442887:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189916400, rc 0) 00000100:00100000:1.0:1790100308.442913:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140885504:12345-0@lo:101: Request processed in 85us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.442919:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790100308.442947:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140885504:0@lo:101: 00010000:00010000:1.0:1790100308.442964:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.442972:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100308.444079:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140885632:0@lo:501: 00000100:00100000:1.0:1790100308.444114:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.444144:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100308.444206:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140885632 00000100:00100000:2.0:1790100308.444213:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140885632 00000100:00100000:2.0:1790100308.444257:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790100308.444266:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140885632:12345-0@lo:501: 00000100:00100000:2.0:1790100308.444409:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140885632:12345-0@lo:501: Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100308.444417:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790100308.444472:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140885632:0@lo:501: 00000100:00100000:1.0:1790100308.444499:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140885760:0@lo:503: 00000100:00100000:1.0:1790100308.444535:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.444607:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100308.444644:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140885760 00000100:00100000:2.0:1790100308.444648:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140885760 00000100:00100000:2.0:1790100308.444679:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790100308.444686:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140885760:12345-0@lo:503: 00000100:00100000:2.0:1790100308.446175:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140885760:12345-0@lo:503: Request processed in 1484us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100308.446187:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790100308.446280:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140885760:0@lo:503: 00000100:00100000:2.0:1790100308.446590:0:8253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8253:1877056140885888:0@lo:502: 00000100:00100000:2.0:1790100308.446640:0:8253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100308.446672:0:8253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6300 going to sleep for 11 seconds 00000100:00100000:1.0:1790100308.446716:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140885888 00000100:00100000:1.0:1790100308.446721:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140885888 00000100:00100000:1.0:1790100308.446759:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790100308.446768:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:8253:x1877056140885888:12345-0@lo:502: 00000100:00100000:1.0:1790100308.446851:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:8253:x1877056140885888:12345-0@lo:502: Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.446858:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790100308.446932:0:8253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8253:1877056140885888:0@lo:502: 00000020:01000000:2.0:1790100308.446952:0:8253:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100308.446961:0:8253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100308.446964:0:8253:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790100308.446971:0:8253:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff926187007800 00000020:00000080:2.0:1790100308.446973:0:8253:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790100308.447064:0:8253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8253:1877056140886016:0@lo:502: 00000100:00100000:2.0:1790100308.447099:0:8253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100308.447128:0:8253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6300 going to sleep for 11 seconds 00000100:00100000:1.0:1790100308.447167:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140886016 00000100:00100000:1.0:1790100308.447172:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140886016 00000100:00100000:1.0:1790100308.447203:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790100308.447211:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:8253:x1877056140886016:12345-0@lo:502: 00000100:00100000:1.0:1790100308.447285:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:8253:x1877056140886016:12345-0@lo:502: Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.447296:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790100308.447635:0:8253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8253:1877056140886016:0@lo:502: 00000020:01000000:3.0:1790100308.447659:0:8253:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100308.447664:0:8253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100308.447666:0:8253:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790100308.447671:0:8253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790100308.448062:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790100308.448085:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100308.448093:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.448103:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100308.808479:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100308.937248:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140886144:0@lo:41: 00000100:00100000:1.0:1790100308.937313:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.937403:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140886144 00000100:00100000:1.0:1790100308.937410:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140886144 00000100:00100000:1.0:1790100308.937460:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790100308.937469:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140886144:12345-0@lo:41: 00000004:00000024:1.0:1790100308.937500:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790100308.937540:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140886144:12345-0@lo:41: Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.937547:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790100308.937589:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140886144:0@lo:41: 00000100:00100000:2.0:1790100308.937822:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140886400:0@lo:400: 00000100:00100000:2.0:1790100308.937859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.937897:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140886272:0@lo:400: 00000100:00100000:1.0:1790100308.937928:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.937972:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140886528:0@lo:400: 00000100:00100000:2.0:1790100308.937983:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140886272 00000100:00100000:2.0:1790100308.937989:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140886272 00000100:00100000:1.0:1790100308.937999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.938032:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100308.938036:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790100308.938061:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+18:3641:x1877056140886272:12345-0@lo:400: 00000100:00100000:1.0:1790100308.938062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140886656:0@lo:400: 00000100:00100000:1.0:1790100308.938098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100308.938134:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140886528 00000100:00100000:1.0:1790100308.938139:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140886528 00000100:00100000:1.0:1790100308.938162:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100308.938169:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140886528:12345-0@lo:400: 00000100:00100000:1.0:1790100308.938205:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140886528:12345-0@lo:400: Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.938212:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100308.938243:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+18:3641:x1877056140886272:12345-0@lo:400: Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.938245:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140886400 00000100:00100000:1.0:1790100308.938250:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140886400 00000100:00100000:2.0:1790100308.938258:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100308.938280:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140886656 00000100:00100000:1.0:1790100308.938285:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140886656 00000100:00100000:1.0:1790100308.938302:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100308.938308:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140886400:12345-0@lo:400: 00000100:00100000:1.0:1790100308.938368:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140886400:12345-0@lo:400: Request processed in 60us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.938375:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100308.938391:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790100308.938393:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9261b8eed500 x1877056140886400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100308.938401:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140886656:12345-0@lo:400: 00000100:00100000:2.0:1790100308.938415:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140886400:0@lo:400: 00000100:00100000:1.0:1790100308.938441:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140886656:12345-0@lo:400: Request processed in 43us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100308.938448:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100308.938474:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140886272:0@lo:400: 00010000:00080000:1.0:1790100308.938495:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9261b8eeca80 x1877056140886656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100308.938504:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140886656:0@lo:400: 00000100:00100000:1.0:1790100308.938521:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140886528:0@lo:400: 00010000:00010000:3.0:1790100309.835702:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790100310.324566:0:8418:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790100310.324570:0:8418:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1790100310.324571:0:8418:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790100310.324693:0:8418:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9261b6950800 00000020:01000004:0.0:1790100310.324719:0:8418:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790100310.324730:0:8418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790100310.324749:0:8418:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9261b79719c0) 00000020:00000080:0.0:1790100310.324764:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790100310.359465:0:8418:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1790100310.359979:0:8418:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1790100310.375969:0:8418:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790100310.376231:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790100310.376241:0:8418:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790100310.376253:0:8418:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc87a4f22982868af 00000020:01000004:2.0:1790100310.376259:0:8418:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790100310.376278:0:8418:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790100310.376282:0:8418:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790100310.376289:0:8418:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790100310.376293:0:8418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790100310.376305:0:8418:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9261b5ab19c0) 00000020:00000080:2.0:1790100310.376320:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1790100310.380366:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100310.380598:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790100310.380604:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790100310.382402:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790100310.382412:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790100310.383452:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790100310.383461:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790100310.390874:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100310.391082:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790100310.391090:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790100310.391971:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790100310.391979:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790100310.413844:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100310.414068:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790100310.414075:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790100310.417252:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790100310.417267:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790100310.419505:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790100310.419517:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790100310.421287:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100310.421568:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790100310.421574:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790100310.422101:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790100310.422106:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790100310.455806:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100310.455990:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790100310.455995:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790100310.457067:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790100310.457076:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790100310.457671:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790100310.457698:0:8418:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790100310.457703:0:8418:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790100310.473674:0:8418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100310.473718:0:8418:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790100310.473722:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100310.473724:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100310.473725:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100310.473726:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100310.473727:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100310.473728:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100310.473730:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100310.473731:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100310.473733:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100310.473734:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100310.473736:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100310.473739:0:8418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790100310.473742:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100310.473743:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100310.473744:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100310.473745:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100310.473746:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100310.473747:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100310.473748:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100310.473748:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100310.473754:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100310.473755:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100310.473755:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100310.473792:0:8418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790100310.473811:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140886784:0@lo:253: 00000100:00100000:2.0:1790100310.473883:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.473931:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff92618556fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100310.474045:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140886784 00000100:00100000:3.0:1790100310.474054:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140886784 00000100:00100000:3.0:1790100310.474099:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790100310.474107:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:8418:x1877056140886784:12345-0@lo:253: 20000000:01000000:3.0:1790100310.474144:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790100310.474148:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790100310.474153:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790100310.474156:0:6505:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790100310.474335:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100310.474510:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1790100310.474524:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790100310.474617:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1790100310.474625:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790100310.474638:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1790100310.474654:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1790100310.474732:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1790100310.474746:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:3.0:1790100310.474748:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1790100310.474762:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1790100310.474767:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790100310.474782:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1790100310.474788:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1790100310.474801:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1790100310.474807:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790100310.474835:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1790100310.474852:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1790100310.474917:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1790100310.474927:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:3.0:1790100310.474929:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1790100310.474942:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1790100310.474947:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790100310.474968:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1790100310.474973:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1790100310.474986:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1790100310.474991:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790100310.475003:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1790100310.475016:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1790100310.475410:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1790100310.475422:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:3.0:1790100310.475424:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1790100310.475437:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1790100310.475442:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790100310.475456:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1790100310.475461:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1790100310.475474:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1790100310.475480:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790100310.475492:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1790100310.475509:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1790100310.475522:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790100310.475525:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790100310.475998:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790100310.476057:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790100310.476060:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790100310.476774:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790100310.476968:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790100310.476992:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790100310.477019:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1790100310.477039:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790100310.477041:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790100310.477623:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1790100310.477648:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1790100310.477664:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1790100310.477821:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1790100310.477842:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1790100310.477857:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1790100310.477866:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1790100310.477869:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790100310.478122:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1790100310.478144:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1790100310.478160:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1790100310.478483:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1790100310.478507:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1790100310.478522:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1790100310.478601:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790100310.478603:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790100310.478904:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1790100310.478925:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1790100310.478942:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1790100310.479099:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1790100310.479115:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1790100310.479126:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1790100310.479138:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790100310.479155:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479171:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189916000/0xc87a4f2298286789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286782 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479179:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479252:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261c2179000/0xc87a4f2298286838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286831 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479260:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926180031c00/0xc87a4f2298286854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828684d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479267:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e59000/0xc87a4f229828687e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286877 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479274:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479310:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e59000/0xc87a4f229828687e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286877 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479454:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e59000/0xc87a4f229828687e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286877 expref: 18 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.479470:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eed180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140886912:0@lo:104: 00000100:00100000:3.0:1790100310.479594:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100310.479670:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926180031c00/0xc87a4f2298286854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828684d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479678:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926180031c00/0xc87a4f2298286854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828684d expref: 18 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.479686:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eec700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140887040:0@lo:104: 00000100:00100000:3.0:1790100310.479703:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100310.479835:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261c2179000/0xc87a4f2298286838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286831 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.479843:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261c2179000/0xc87a4f2298286838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286831 expref: 18 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.479852:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140887168:0@lo:104: 00000100:00100000:3.0:1790100310.479874:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.479894:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140886912 00000100:00100000:2.0:1790100310.479901:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140886912 00000100:00100000:1.0:1790100310.479949:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140887040 00000100:00100000:1.0:1790100310.479953:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140887040 00000100:00100000:1.0:1790100310.479975:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100310.479984:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140886912:12345-0@lo:104: 00010000:00010000:1.0:1790100310.479996:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.480097:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100310.480105:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140886912:12345-0@lo:104: Request processed in 122us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.480112:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100310.480127:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100310.480134:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140887040:12345-0@lo:104: 00010000:00010000:1.0:1790100310.480141:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f229828684d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480186:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480196:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 18 pid: 6507 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100310.480205:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1790100310.480212:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1790100310.480357:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140887296:0@lo:104: 00000100:00100000:3.0:1790100310.480395:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100310.480415:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189916000/0xc87a4f2298286789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286782 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480423:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189916000/0xc87a4f2298286789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286782 expref: 18 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480424:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1790100310.480431:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082130380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140887424:0@lo:104: 00010000:00010000:0.0:1790100310.480432:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480438:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189917400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100310.480442:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.480449:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100310.480450:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.480457:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5b3af00 going to sleep for 11 seconds 10000000:00010000:0.0:1790100310.480458:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100310.480463:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1790100310.480474:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eed180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140886912:0@lo:104: 00000100:00100000:3.0:1790100310.480482:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eec700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140887040:0@lo:104: 00010000:00010000:0.0:1790100310.480497:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480504:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100310.480523:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286877 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.480539:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100310.480549:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140887552:0@lo:103: 00000100:00100000:3.0:1790100310.480572:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.480601:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140887552 00000100:00100000:3.0:1790100310.480605:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140887552 00000100:00100000:2.0:1790100310.480618:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140887168 00000100:00100000:2.0:1790100310.480621:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140887168 00010000:00010000:3.0:1790100310.480622:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e59000/0xc87a4f229828687e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286877 expref: 19 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100310.480635:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1790100310.480640:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100310.480640:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140887296 00000100:00100000:2.0:1790100310.480642:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140887296 00000100:00100000:3.0:1790100310.480646:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+19:3642:x1877056140887552:12345-0@lo:103: 00000100:00100000:2.0:1790100310.480650:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1790100310.480653:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140887424 00010000:00010000:3.0:1790100310.480655:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790100310.480655:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140887424 00010000:00010000:3.0:1790100310.480660:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e59000/0xc87a4f229828687e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286877 expref: 19 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480669:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e59000/0xc87a4f229828687e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286877 expref: 19 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480687:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828687e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480692:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59000/0xc87a4f229828687e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286877 expref: 19 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480699:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100310.480702:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100310.480703:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f229828684d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480726:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100310.480729:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f229828684d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.480735:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+18:3642:x1877056140887552:12345-0@lo:103: Request processed in 90us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1790100310.480736:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f229828684d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.480742:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 10000000:00010000:0.0:1790100310.480743:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f229828684d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100310.480748:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790100310.480764:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f229828684d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480770:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100310.480776:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f229828684d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480781:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f229828684d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286854 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480791:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100310.480793:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100310.480795:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100310.480801:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100310.480809:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140887680:0@lo:103: 00000100:00100000:3.0:1790100310.480816:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100310.480821:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+6:6505:x1877056140887168:12345-0@lo:104: 00010000:00010000:3.0:1790100310.480829:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298286831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.480833:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.480858:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140887680 00000100:00100000:0.0:1790100310.480861:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140887680 00000100:00100000:3.0:1790100310.480866:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140887168:0@lo:104: 00010000:00010000:3.0:1790100310.480880:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1790100310.480881:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926180031c00/0xc87a4f2298286854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828684d expref: 18 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.480885:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+6:6505:x1877056140887168:12345-0@lo:104: Request processed in 64us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.480890:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100310.480899:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1790100310.480901:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790100310.480904:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+18:3641:x1877056140887680:12345-0@lo:103: 00010000:00010000:3.0:1790100310.480906:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298286831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480911:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100310.480912:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c600 already unused, calling callback (ffffffffc13ccc20) 00010000:00010000:0.0:1790100310.480914:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926180031c00/0xc87a4f2298286854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828684d expref: 18 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100310.480915:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298286831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480923:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298286831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480924:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926180031c00/0xc87a4f2298286854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828684d expref: 18 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480935:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180031c00/0xc87a4f2298286854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828684d expref: 18 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100310.480940:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298286831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.480944:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:3.0:1790100310.480946:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100310.480959:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298286831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480965:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790100310.480968:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+17:3641:x1877056140887680:12345-0@lo:103: Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.480974:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1790100310.480978:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298286831 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480984:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298286831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286838 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.480993:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100310.480995:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100310.480995:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140887680:0@lo:103: 00010000:00010000:3.0:1790100310.480996:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100310.481005:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140887808:0@lo:103: 00000100:00100000:3.0:1790100310.481040:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.481064:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140887552:0@lo:103: 00000100:00100000:3.0:1790100310.481074:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100310.481080:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+5:6505:x1877056140887296:12345-0@lo:104: 00010000:00010000:3.0:1790100310.481088:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f22982867f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.481105:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140887808 00000100:00100000:0.0:1790100310.481108:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140887808 00010000:00010000:0.0:1790100310.481122:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261c2179000/0xc87a4f2298286838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286831 expref: 17 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.481130:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100310.481135:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+5:6505:x1877056140887296:12345-0@lo:104: Request processed in 57us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.481138:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100310.481141:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100310.481143:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+17:3643:x1877056140887808:12345-0@lo:103: 00010000:00010000:0.0:1790100310.481150:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100310.481154:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261c2179000/0xc87a4f2298286838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286831 expref: 17 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.481159:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100310.481163:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f22982867f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481166:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261c2179000/0xc87a4f2298286838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286831 expref: 17 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.481170:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59800 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100310.481173:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f22982867f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481177:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261c2179000/0xc87a4f2298286838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286831 expref: 17 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.481181:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f22982867f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100310.481187:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f22982867f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100310.481192:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790100310.481275:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100310.481303:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+16:3643:x1877056140887808:12345-0@lo:103: Request processed in 160us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.481310:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790100310.481367:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1790100310.481385:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140887040:12345-0@lo:104: Request processed in 1252us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.481390:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100310.481404:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100310.481412:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140887424:12345-0@lo:104: 00010000:00010000:1.0:1790100310.481419:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261c2179200/0xc87a4f2298286782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.481452:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100310.481456:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140887424:12345-0@lo:104: Request processed in 47us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.481461:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100310.481524:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140887296:0@lo:104: 00000100:00100000:2.0:1790100310.481607:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082130380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140887424:0@lo:104: 00010000:00010000:2.0:1790100310.481627:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.481729:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140887808:0@lo:103: 00010000:00010000:0.0:1790100310.481747:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100310.481750:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261c2179200/0xc87a4f2298286782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481756:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261c2179200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100310.481759:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179200/0xc87a4f2298286782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481766:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261c2179200/0xc87a4f2298286782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100310.481772:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179200/0xc87a4f2298286782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100310.481777:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790100310.481795:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261c2179200/0xc87a4f2298286782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481809:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100310.481829:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261c2179200/0xc87a4f2298286782 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481836:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261c2179200/0xc87a4f2298286782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286789 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481845:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100310.481846:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100310.481847:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100310.481852:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100310.481861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140887936:0@lo:103: 00000100:00100000:0.0:1790100310.481885:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.481911:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140887936 00000100:00100000:0.0:1790100310.481915:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140887936 00010000:00010000:0.0:1790100310.481930:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189916000/0xc87a4f2298286789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286782 expref: 16 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.481947:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100310.481953:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+16:3643:x1877056140887936:12345-0@lo:103: 00010000:00010000:0.0:1790100310.481960:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100310.481964:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189916000/0xc87a4f2298286789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286782 expref: 16 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481971:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189916000/0xc87a4f2298286789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286782 expref: 16 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.481981:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189916000/0xc87a4f2298286789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286782 expref: 16 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.482000:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100310.482038:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+15:3643:x1877056140887936:12345-0@lo:103: Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.482045:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100310.482069:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140887936:0@lo:103: 00010000:00010000:2.0:1790100310.482473:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100310.482536:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f22982867f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.482543:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100310.482568:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f22982867f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.482575:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f22982867f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286800 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.482589:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100310.482591:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100310.482592:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100310.482600:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100310.482610:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140888064:0@lo:103: 00000100:00100000:1.0:1790100310.482638:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.482690:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140888064 00000100:00100000:0.0:1790100310.482694:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140888064 00010000:00010000:0.0:1790100310.482714:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 15 pid: 6507 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100310.482804:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100310.482813:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184255450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+15:3642:x1877056140888064:12345-0@lo:103: 00010000:00010000:1.0:1790100310.482822:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100310.482827:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 15 pid: 6507 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482836:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 15 pid: 6507 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482847:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982867f9 expref: 15 pid: 6507 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482859:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482874:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482886:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482893:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482899:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482906:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482911:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100310.482915:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482920:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482932:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.482941:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100310.482956:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.482964:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100310.482980:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184255450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+14:3642:x1877056140888064:12345-0@lo:103: Request processed in 170us (341us total) trans 0 rc 0/0 00010000:00010000:2.0:1790100310.482981:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565d000/0xc87a4f22982868bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100310.482987:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 20000000:01000000:2.0:1790100310.482994:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790100310.483464:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140888064:0@lo:103: 00000100:00100000:3.0:1790100310.484749:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+13:8418:x1877056140886784:12345-0@lo:253: Request processed in 10638us (10860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.484771:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790100310.484861:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140886784:0@lo:253: 10000000:01000000:0.0:1790100310.484875:0:8418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790100310.484878:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790100310.484880:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790100310.484882:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100310.484883:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1790100310.484884:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100310.484885:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100310.484886:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100310.484888:0:8418:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790100310.484889:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100310.484890:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790100310.484907:0:8418:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9261b6950800 from lustre-OST0000 10000000:01000000:0.0:1790100310.484950:0:8418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790100310.484953:0:8418:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790100310.484961:0:8418:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9261b2304d40 local copy 10000000:01000000:0.0:1790100310.484965:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790100310.484994:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.485004:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.485018:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.485054:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888192:0@lo:101: 00000100:00100000:0.0:1790100310.485087:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.485122:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365540 going to sleep for 11 seconds 00000100:00100000:1.0:1790100310.485167:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140888192 00000100:00100000:1.0:1790100310.485179:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140888192 00000100:00100000:1.0:1790100310.485228:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790100310.485236:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+13:8418:x1877056140888192:12345-0@lo:101: 00010000:00010000:1.0:1790100310.485249:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100310.485262:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189917600/0xc87a4f22982868cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982868c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.485281:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189917600/0xc87a4f22982868cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982868c4 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.485291:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189917600/0xc87a4f22982868cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982868c4 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.485299:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189917600, rc 0) 00000100:00100000:1.0:1790100310.485335:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888192:12345-0@lo:101: Request processed in 99us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.485421:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790100310.485637:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888192:0@lo:101: 00010000:00010000:0.0:1790100310.485650:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.485658:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.485733:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888320:0@lo:501: 00000100:00100000:0.0:1790100310.485759:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.485787:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100310.485803:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140888320 00000100:00100000:2.0:1790100310.485808:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140888320 00000100:00100000:2.0:1790100310.485839:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790100310.485847:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888320:12345-0@lo:501: 00000100:00100000:2.0:1790100310.485950:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888320:12345-0@lo:501: Request processed in 104us (189us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790100310.485957:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790100310.486064:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888320:0@lo:501: 10000000:01000000:0.0:1790100310.486077:0:8418:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790100310.486094:0:8418:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790100310.486100:0:8418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.486108:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.486115:0:8418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.486146:0:8418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790100310.486166:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9261b6950800 10000000:01000000:0.0:1790100310.486171:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790100310.486175:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790100310.486178:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790100310.486182:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790100310.486193:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790100310.486209:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.486216:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.486224:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.486235:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888448:0@lo:101: 00000100:00100000:0.0:1790100310.486260:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100310.486266:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100310.486279:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.486279:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365b40 going to sleep for 11 seconds 00010000:00010000:2.0:1790100310.486287:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100310.486290:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.486298:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100310.486306:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100310.486311:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100310.486328:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.486360:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100310.486381:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.486385:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140888448 00010000:00010000:2.0:1790100310.486388:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f22982868c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f22982868cb expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.486389:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140888448 00010000:00010000:2.0:1790100310.486398:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100310.486400:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100310.486402:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100310.486408:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100310.486411:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790100310.486417:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888448:12345-0@lo:101: 00000100:00100000:2.0:1790100310.486417:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140888576:0@lo:103: 00010000:00010000:3.0:1790100310.486425:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100310.486433:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982868d2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100310.486441:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100310.486449:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.486458:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.486466:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565d400, rc 0) 00000100:00100000:2.0:1790100310.486466:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140888576 00000100:00100000:2.0:1790100310.486469:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140888576 00000100:00100000:3.0:1790100310.486492:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140888448:12345-0@lo:101: Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.486493:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100310.486498:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790100310.486499:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+16:3641:x1877056140888576:12345-0@lo:103: 00010000:00010000:2.0:1790100310.486506:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100310.486516:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189917600/0xc87a4f22982868cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f22982868c4 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.486525:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100310.486558:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+14:3641:x1877056140888576:12345-0@lo:103: Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.486564:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100310.486577:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888448:0@lo:101: 00010000:00010000:0.0:1790100310.486587:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.486594:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.486643:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888704:0@lo:501: 00000100:00100000:0.0:1790100310.486673:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.486690:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100310.486791:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140888576:0@lo:103: 00000100:00100000:2.0:1790100310.487305:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140888704 00000100:00100000:2.0:1790100310.487310:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140888704 00000100:00100000:2.0:1790100310.487360:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790100310.487374:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888704:12345-0@lo:501: 00000100:00100000:2.0:1790100310.487483:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888704:12345-0@lo:501: Request processed in 110us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.487490:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790100310.487566:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888704:0@lo:501: 00000100:00100000:0.0:1790100310.487605:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888832:0@lo:503: 00000100:00100000:0.0:1790100310.487644:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.487675:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100310.487683:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140888832 00000100:00100000:3.0:1790100310.487690:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140888832 00000100:00100000:3.0:1790100310.487726:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790100310.487734:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888832:12345-0@lo:503: 00000100:00100000:3.0:1790100310.487823:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888832:12345-0@lo:503: Request processed in 89us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.487830:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790100310.487959:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888832:0@lo:503: 00000040:00080000:0.0:1790100310.488289:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100310.488384:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888960:0@lo:502: 00000100:00100000:0.0:1790100310.488424:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.488447:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100310.488460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140888960 00000100:00100000:2.0:1790100310.488465:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140888960 00000100:00100000:2.0:1790100310.488503:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790100310.488511:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888960:12345-0@lo:502: 00000100:00100000:2.0:1790100310.490115:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140888960:12345-0@lo:502: Request processed in 1600us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.490128:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100310.490206:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140888960:0@lo:502: 00000040:00080000:3.0:1790100310.490538:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790100310.490568:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790100310.490878:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790100310.490905:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790100310.490922:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790100310.490935:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790100310.491042:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889088:0@lo:502: 00000100:00100000:3.0:1790100310.491249:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.491288:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100310.491335:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140889088 00000100:00100000:0.0:1790100310.491376:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140889088 00000100:00100000:0.0:1790100310.491417:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790100310.491429:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140889088:12345-0@lo:502: 00000100:00100000:0.0:1790100310.491767:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140889088:12345-0@lo:502: Request processed in 340us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.491774:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790100310.492169:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889088:0@lo:502: 00000040:00080000:3.0:1790100310.492228:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790100310.492238:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1790100310.492780:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100310.492787:0:8442:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1790100310.492793:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100310.492795:0:8442:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790100310.492801:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100310.492815:0:8442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9261b7974d40) 00000020:00000080:0.0:1790100310.492835:0:8442:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790100310.492841:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790100310.492920:0:8442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261b6950800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790100310.492932:0:8442:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790100310.492939:0:8442:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc87a4f22982868e7 00010000:00010000:1.0:1790100310.498439:0:8442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1790100310.498776:0:8442:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1790100310.501397:0:8442:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790100310.501818:0:8442:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1790100310.507299:0:8442:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1790100310.509153:0:8442:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1790100310.516149:0:8442:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1790100310.522135:0:8442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790100310.522148:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100310.522155:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100310.522158:0:8442:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790100310.522161:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100310.522166:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100310.522167:0:8442:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790100310.522170:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790100310.522172:0:8442:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790100310.522195:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100310.522198:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100310.522200:0:8442:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790100310.522204:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790100310.522313:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790100310.522376:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790100310.522394:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.522406:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100310.522416:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b6950800 from 1 10000000:01000000:3.0:1790100310.522419:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100310.522454:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.522480:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.522490:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.522522:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889216:0@lo:101: 00000100:00100000:3.0:1790100310.522592:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.522643:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100310.522735:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140889216 00000100:00100000:2.0:1790100310.522743:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140889216 00000100:00100000:2.0:1790100310.522793:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790100310.522804:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:8418:x1877056140889216:12345-0@lo:101: 00010000:00010000:2.0:1790100310.522818:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100310.522837:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982868ee expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.522861:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982868ee expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.522872:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982868ee expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.522881:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031e00, rc 0) 00000100:00100000:2.0:1790100310.522934:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889216:12345-0@lo:101: Request processed in 132us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.522950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790100310.523070:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889216:0@lo:101: 00010000:00010000:0.0:1790100310.523084:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100310.523092:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100310.523173:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889344:0@lo:501: 00000100:00100000:0.0:1790100310.523311:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.523335:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff92618420c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100310.523426:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140889344 00000100:00100000:3.0:1790100310.523432:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140889344 00000100:00100000:3.0:1790100310.523463:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790100310.523469:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889344:12345-0@lo:501: 00000100:00100000:3.0:1790100310.523556:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889344:12345-0@lo:501: Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.523562:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790100310.523636:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889344:0@lo:501: 00000100:00100000:0.0:1790100310.523663:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889472:0@lo:503: 00000100:00100000:0.0:1790100310.523703:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.523731:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff92618420c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100310.524317:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140889472 00000100:00100000:3.0:1790100310.524323:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140889472 00000100:00100000:3.0:1790100310.524367:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790100310.524375:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889472:12345-0@lo:503: 00000100:00100000:3.0:1790100310.525121:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889472:12345-0@lo:503: Request processed in 745us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.525130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790100310.525299:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889472:0@lo:503: 00000040:00080000:0.0:1790100310.525546:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100310.525619:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889600:0@lo:502: 00000100:00100000:0.0:1790100310.525657:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.525686:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140889600 00000100:00100000:0.0:1790100310.525691:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140889600 00000100:00100000:0.0:1790100310.525721:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100310.525729:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889600:12345-0@lo:502: 00000100:00100000:0.0:1790100310.525802:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889600:12345-0@lo:502: Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.525813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100310.525851:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff92618420c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100310.525864:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889600:0@lo:502: 00000040:00080000:0.0:1790100310.526042:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790100310.526071:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790100310.526089:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889728:0@lo:502: 00000100:00100000:0.0:1790100310.526121:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100310.526142:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140889728 00000100:00100000:0.0:1790100310.526146:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140889728 00000100:00100000:0.0:1790100310.526166:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100310.526172:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889728:12345-0@lo:502: 00000100:00100000:2.0:1790100310.526777:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff92618420c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100310.528624:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889728:12345-0@lo:502: Request processed in 2445us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.528637:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790100310.529237:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889728:0@lo:502: 00000040:00080000:2.0:1790100310.530516:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790100310.530532:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790100310.532334:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100310.532409:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100310.532412:0:8446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790100310.532420:0:8446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261b6950800 00000020:00000080:0.0:1790100310.532423:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790100310.532437:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100310.532439:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100310.532442:0:8446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790100310.532444:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790100310.532612:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790100310.532635:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790100310.532688:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.532700:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100310.532742:0:8418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790100310.532745:0:8418:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9261b6950800 10000000:01000000:2.0:1790100310.532748:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9261b6950800 10000000:01000000:2.0:1790100310.532751:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790100310.532757:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b6950800 from 1 10000000:01000000:2.0:1790100310.532766:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790100310.532799:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.532807:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.532818:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100310.532838:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889856:0@lo:101: 00000100:00100000:2.0:1790100310.532911:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.532947:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100310.533082:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140889856 00000100:00100000:1.0:1790100310.533091:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140889856 00000100:00100000:1.0:1790100310.533156:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790100310.533165:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:8418:x1877056140889856:12345-0@lo:101: 00010000:00010000:1.0:1790100310.533178:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100310.533190:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982868fc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.533215:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982868fc expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.533225:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982868fc expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.533234:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189917800, rc 0) 00000100:00100000:1.0:1790100310.533272:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140889856:12345-0@lo:101: Request processed in 109us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.533279:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790100310.533410:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889856:0@lo:101: 00010000:00010000:2.0:1790100310.533428:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.533437:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100310.533513:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889984:0@lo:501: 00000100:00100000:2.0:1790100310.533543:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.533573:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100310.534272:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140889984 00000100:00100000:1.0:1790100310.534278:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140889984 00000100:00100000:1.0:1790100310.534326:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790100310.534334:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140889984:12345-0@lo:501: 00000100:00100000:1.0:1790100310.534469:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140889984:12345-0@lo:501: Request processed in 135us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.534476:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790100310.535058:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140889984:0@lo:501: 00000100:00100000:2.0:1790100310.535096:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140890112:0@lo:503: 00000100:00100000:2.0:1790100310.535143:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.535182:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d100c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100310.535233:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140890112 00000100:00100000:0.0:1790100310.535239:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140890112 00000100:00100000:0.0:1790100310.535303:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790100310.535312:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140890112:12345-0@lo:503: 00000100:00100000:0.0:1790100310.535426:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140890112:12345-0@lo:503: Request processed in 115us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.535438:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790100310.535477:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140890112:0@lo:503: 00000040:00080000:3.0:1790100310.535693:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100310.535764:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140890240:0@lo:502: 00000100:00100000:3.0:1790100310.535801:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.539022:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1790100310.539123:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140890240 00000100:00100000:2.0:1790100310.539146:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140890240 00000100:00100000:2.0:1790100310.539192:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790100310.539200:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140890240:12345-0@lo:502: 00000100:00100000:2.0:1790100310.539410:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140890240:12345-0@lo:502: Request processed in 210us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.539417:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790100310.539525:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140890240:0@lo:502: 00000040:00080000:3.0:1790100310.539726:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790100310.539756:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790100310.539778:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790100310.539791:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790100310.539803:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790100310.539814:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790100310.539826:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790100310.539838:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790100310.539852:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790100310.539865:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790100310.539955:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790100310.539969:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790100310.539979:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790100310.539990:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790100310.540012:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790100310.540024:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790100310.540049:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790100310.540062:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790100310.540074:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790100310.540087:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790100310.540101:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790100310.540115:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790100310.540130:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790100310.540145:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790100310.540160:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1790100310.540175:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1790100310.540190:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1790100310.540205:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1790100310.540218:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1790100310.540230:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1790100310.540258:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1790100310.540274:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1790100310.540287:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1790100310.540302:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1790100310.540316:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1790100310.540649:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1790100310.540667:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1790100310.540700:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140890368:0@lo:502: 00000100:00100000:3.0:1790100310.540749:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.540837:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1790100310.540932:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140890368 00000100:00100000:2.0:1790100310.540938:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140890368 00000100:00100000:2.0:1790100310.540998:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790100310.541006:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140890368:12345-0@lo:502: 00000100:00100000:2.0:1790100310.541106:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140890368:12345-0@lo:502: Request processed in 100us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.541113:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790100310.541179:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140890368:0@lo:502: 00000040:00080000:3.0:1790100310.541214:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1790100310.541222:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1790100310.541658:0:8447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790100310.541672:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9261b7673380) 00000020:00000080:3.0:1790100310.541694:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1790100310.541777:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261b6950800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790100310.541781:0:8447:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261b6950800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790100310.541784:0:8447:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b6950800 3 00010000:00080000:3.0:1790100310.541809:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff926082856000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1790100310.543456:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1790100310.543628:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790100310.543664:0:8447:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790100310.543676:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc87a4f2298286911 00000100:00080000:3.0:1790100310.543684:0:8447:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790100310.543694:0:8447:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff926082856000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100310.543724:0:8447:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926082131f80 x1877056140890496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790100310.543764:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056140890496:0@lo:38: 00000100:00100000:3.0:1790100310.543820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.543874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140890496 00000100:00100000:3.0:1790100310.543881:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140890496 00000100:00100000:3.0:1790100310.543908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100310.543921:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877056140890496:12345-0@lo:38: 00010000:00080000:3.0:1790100310.543941:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1790100310.543965:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc87a4f2298286918 00000004:00100000:3.0:1790100310.543977:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790100310.544003:0:6514:0:(import.c:65:import_set_state_nolock()) ffff926082855800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100310.544060:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877056140890496:12345-0@lo:38: Request processed in 138us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.544066:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790100310.544100:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926082131f80 x1877056140890496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100310.544109:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100310.544117:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790100310.544123:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790100310.544127:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790100310.544129:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926082856000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790100310.544134:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056140890496:0@lo:38: 00000100:00080000:3.0:1790100310.544150:0:8447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790100310.544224:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140890624:0@lo:400: 00000100:00100000:3.0:1790100310.544250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.544268:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100310.544273:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140890752:0@lo:400: 00000100:00100000:3.0:1790100310.544295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.544326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140890880:0@lo:400: 00000100:00100000:3.0:1790100310.544368:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.544385:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100310.544397:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140891008:0@lo:400: 00000100:00100000:3.0:1790100310.544427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.544458:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140890624 00000100:00100000:3.0:1790100310.544461:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140890624 00000100:00100000:3.0:1790100310.544485:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140890880 00000100:00100000:3.0:1790100310.544488:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140890880 00000100:00100000:3.0:1790100310.544499:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790100310.544505:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140890624:12345-0@lo:400: 00000100:00100000:3.0:1790100310.544539:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140890624:12345-0@lo:400: Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.544546:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790100310.544556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100310.544562:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140890880:12345-0@lo:400: 00000100:00100000:3.0:1790100310.544588:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140890880:12345-0@lo:400: Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.544594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100310.544610:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140890752 00000100:00100000:3.0:1790100310.544613:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140890752 00000100:00100000:3.0:1790100310.544632:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140891008 00000100:00100000:3.0:1790100310.544635:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140891008 00000100:00100000:3.0:1790100310.544645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790100310.544651:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140890752:12345-0@lo:400: 00000100:00100000:3.0:1790100310.544679:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140890752:12345-0@lo:400: Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.544685:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790100310.544696:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790100310.544702:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140891008:12345-0@lo:400: 00000100:00100000:3.0:1790100310.544727:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140891008:12345-0@lo:400: Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.544739:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790100310.544773:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140890752:0@lo:400: 00010000:00080000:3.0:1790100310.544784:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926082131f80 x1877056140890624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100310.544794:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140890624:0@lo:400: 00000100:00100000:3.0:1790100310.544818:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140891008:0@lo:400: 00010000:00080000:3.0:1790100310.544827:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926082131880 x1877056140890880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100310.544835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140890880:0@lo:400: 00000020:01000004:3.0:1790100310.544994:0:8447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790100310.545014:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff926082960000) 00000020:00000080:3.0:1790100310.549603:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1790100310.549685:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261b6950800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790100310.549690:0:8447:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261b6950800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790100310.549692:0:8447:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b6950800 3 00010000:00080000:3.0:1790100310.549725:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff926082852000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1790100310.551825:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1790100310.551994:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1790100310.552042:0:8447:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790100310.552054:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc87a4f2298286926 00000100:00080000:3.0:1790100310.552063:0:8447:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790100310.552073:0:8447:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff926082852000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100310.552103:0:8447:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926082131880 x1877056140891136/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790100310.552144:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1877056140891136:0@lo:38: 00000100:00100000:3.0:1790100310.552206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.552260:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140891136 00000100:00100000:3.0:1790100310.552266:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140891136 00000100:00100000:3.0:1790100310.552291:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100310.552298:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1877056140891136:12345-0@lo:38: 00010000:00080000:3.0:1790100310.552318:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1790100310.552368:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc87a4f229828692d 00000004:00100000:3.0:1790100310.552380:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790100310.552406:0:6512:0:(import.c:65:import_set_state_nolock()) ffff926082854800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100310.552446:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877056140891136:12345-0@lo:38: Request processed in 148us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.552453:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790100310.552487:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926082131880 x1877056140891136/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100310.552496:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100310.552502:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790100310.552508:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790100310.552512:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790100310.552513:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926082852000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790100310.552518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1877056140891136:0@lo:38: 00000100:00080000:3.0:1790100310.552536:0:8447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1790100310.555481:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1790100310.557989:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1790100310.558042:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790100310.558064:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.558076:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790100310.558133:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790100310.558135:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790100310.558136:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100310.558142:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100310.558143:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100310.558145:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100310.558146:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100310.558147:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790100310.558148:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790100310.558149:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100310.558150:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790100310.558153:0:8418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1790100310.558155:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790100310.558156:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790100310.558157:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100310.558158:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100310.558159:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100310.558160:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100310.558160:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100310.558161:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790100310.558162:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790100310.558162:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100310.558163:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790100310.558187:0:8418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790100310.558203:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140891264:0@lo:253: 00000100:00100000:1.0:1790100310.558264:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100310.558303:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140891264 00000100:00100000:1.0:1790100310.558309:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140891264 00000100:00100000:1.0:1790100310.558372:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790100310.558380:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140891264:12345-0@lo:253: 20000000:01000000:1.0:1790100310.558405:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790100310.558416:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790100310.558519:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0000 going to sleep for 11 seconds 20000000:01000000:1.0:1790100310.564068:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790100310.564119:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790100310.564421:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:8418:x1877056140891264:12345-0@lo:253: Request processed in 6038us (6152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.564434:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790100310.564564:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:8418:1877056140891264:0@lo:253: 10000000:01000000:2.0:1790100310.564578:0:8418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790100310.564582:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790100310.564583:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100310.564585:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100310.564587:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100310.564605:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100310.564607:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100310.564608:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100310.564609:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100310.564611:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100310.564612:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100310.564613:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790100310.564628:0:8418:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1790100310.571064:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790100310.571073:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790100310.571101:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571135:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261c2178400/0xc87a4f229828682a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286823 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571142:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828683f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571148:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571186:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828683f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571200:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828683f expref: 15 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.571214:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140891392:0@lo:104: 00000100:00100000:3.0:1790100310.571277:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100310.571335:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261c2178400/0xc87a4f229828682a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286823 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571361:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261c2178400/0xc87a4f229828682a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286823 expref: 15 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100310.571370:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140891520:0@lo:104: 00000100:00100000:3.0:1790100310.571389:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100310.571472:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790100310.571496:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100310.571522:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140891392 00000100:00100000:1.0:1790100310.571528:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140891392 00000100:00100000:1.0:1790100310.571566:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140891520 00000100:00100000:1.0:1790100310.571568:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140891520 00000100:00100000:1.0:1790100310.571582:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100310.571588:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b68d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+4:6528:x1877056140891392:12345-0@lo:104: 00010000:00010000:1.0:1790100310.571600:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261c2179400/0xc87a4f229828683f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.571652:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100310.571659:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b68d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+4:6528:x1877056140891392:12345-0@lo:104: Request processed in 70us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.571665:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100310.571699:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790100310.571704:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:6528:x1877056140891520:12345-0@lo:104: 00010000:00010000:1.0:1790100310.571711:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298286823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.571745:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790100310.571750:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:6528:x1877056140891520:12345-0@lo:104: Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.571755:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1790100310.571823:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100310.571829:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261c2179400/0xc87a4f229828683f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571847:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261c2179400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100310.571851:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179400/0xc87a4f229828683f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571859:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261c2179400/0xc87a4f229828683f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100310.571866:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179400/0xc87a4f229828683f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100310.571872:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100310.571898:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261c2179400/0xc87a4f229828683f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571905:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100310.571919:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261c2179400/0xc87a4f229828683f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571925:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261c2179400/0xc87a4f229828683f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286846 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571937:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100310.571940:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298286823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.571946:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565de00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100310.571949:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298286823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.572139:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298286823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100310.572145:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298286823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100310.572150:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100310.572164:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298286823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.572170:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100310.572175:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298286823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.572181:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298286823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828682a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100310.572193:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100310.572195:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100310.572196:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100310.572214:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140891648:0@lo:103: 00000100:00100000:3.0:1790100310.572242:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100310.572332:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1790100310.572627:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1790100310.572803:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1790100310.573002:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1790100310.573215:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1790100310.573442:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1790100310.573666:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1790100310.574052:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100310.574064:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140891776:0@lo:103: 00000100:00100000:3.0:1790100310.574107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.574503:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140891392:0@lo:104: 00000100:00100000:3.0:1790100310.574513:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140891520:0@lo:104: 00010000:00010000:3.0:1790100310.574535:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1790100310.575394:0:8418:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1790100310.575559:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140891648 00000100:00100000:1.0:1790100310.575566:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140891648 00010000:00010000:1.0:1790100310.575595:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828683f expref: 16 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100310.575623:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140891776 00000100:00100000:1.0:1790100310.575633:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140891776 00010000:00010000:1.0:1790100310.575649:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261c2178400/0xc87a4f229828682a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286823 expref: 17 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100310.575663:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100310.575670:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+17:3643:x1877056140891648:12345-0@lo:103: 00010000:00010000:1.0:1790100310.575683:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100310.575688:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828683f expref: 17 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575697:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828683f expref: 17 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575712:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828683f expref: 17 pid: 6506 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575725:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100310.575784:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+16:3643:x1877056140891648:12345-0@lo:103: Request processed in 113us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.575790:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100310.575806:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790100310.575812:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+15:3643:x1877056140891776:12345-0@lo:103: 00010000:00010000:1.0:1790100310.575819:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100310.575822:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261c2178400/0xc87a4f229828682a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286823 expref: 15 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575829:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261c2178400/0xc87a4f229828682a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286823 expref: 15 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575838:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261c2178400/0xc87a4f229828682a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286823 expref: 15 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575854:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575861:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790100310.575874:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004801735s 00010000:00010000:1.0:1790100310.575880:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575885:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575891:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575897:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575903:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100310.575908:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575916:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575928:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100310.575937:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100310.576033:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+14:3643:x1877056140891776:12345-0@lo:103: Request processed in 213us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100310.576040:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100310.576464:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140891776:0@lo:103: 00000100:00100000:2.0:1790100310.576473:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140891648:0@lo:103: 00010000:00010000:2.0:1790100310.578828:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.578843:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100310.578851:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565d600/0xc87a4f2298286934 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1790100310.585544:0:8418:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790100310.585552:0:8418:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790100310.585591:0:8418:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790100310.585634:0:8418:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790100310.585651:0:8418:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790100310.585669:0:8418:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1790100310.586460:0:8418:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100310.586626:0:8418:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1790100310.857366:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790100311.196755:0:8503:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100311.196974:0:8503:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100311.881499:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100312.904634:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100313.035137:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100313.035161:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140891904:0@lo:41: 00000100:00100000:0.0:1790100313.035223:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100313.035303:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140891904 00000100:00100000:2.0:1790100313.035312:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140891904 00000100:00100000:2.0:1790100313.035378:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790100313.035387:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140891904:12345-0@lo:41: 00000004:00000024:2.0:1790100313.035419:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1790100313.035480:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140891904:12345-0@lo:41: Request processed in 93us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100313.035487:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100313.035580:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140891904:0@lo:41: 00010000:00010000:2.0:1790100313.929819:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100314.056531:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140892032:0@lo:41: 00000100:00100000:3.0:1790100314.056600:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100314.058757:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140892032 00000100:00100000:3.0:1790100314.058770:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140892032 00000100:00100000:1.0:1790100314.058859:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790100314.058872:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140892032:12345-0@lo:41: 00000004:00000024:1.0:1790100314.058941:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790100314.059028:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140892032:12345-0@lo:41: Request processed in 159us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100314.059035:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100314.059056:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140892032:0@lo:41: 00000001:02000400:2.0:1790100314.692615:0:8793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790100314.953303:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790100315.341409:0:8845:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100315.341651:0:8845:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790100315.592611:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140892544:0@lo:400: 00000100:00100000:3.0:1790100315.592677:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100315.592710:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056140892288:0@lo:400: 00000100:00100000:3.0:1790100315.592736:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790100315.592747:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140892416:0@lo:400: 00000100:00100000:0.0:1790100315.592748:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100315.592778:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056140892800:0@lo:400: 00000100:00100000:3.0:1790100315.592785:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100315.592812:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140892928:0@lo:400: 00000100:00100000:0.0:1790100315.592814:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100315.592840:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790100315.592847:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140892160:0@lo:400: 00000100:00100000:3.0:1790100315.592863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100315.592882:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100315.592901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140892544 00000100:00100000:3.0:1790100315.592910:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140892544 00000100:00100000:0.0:1790100315.592910:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140892672:0@lo:400: 00000100:00100000:3.0:1790100315.592948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140892288 00000100:00100000:3.0:1790100315.592952:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140892288 00000100:00100000:0.0:1790100315.592952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100315.592967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140892800 00000100:00100000:3.0:1790100315.592970:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140892800 00000100:00100000:3.0:1790100315.593008:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140892928 00000100:00100000:3.0:1790100315.593017:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140892928 00000100:00100000:3.0:1790100315.593036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100315.593043:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140892544:12345-0@lo:400: 00000100:00100000:3.0:1790100315.593092:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140892544:12345-0@lo:400: Request processed in 49us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100315.593098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100315.593113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100315.593119:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056140892288:12345-0@lo:400: 00000100:00100000:3.0:1790100315.593149:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056140892288:12345-0@lo:400: Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100315.593154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100315.593165:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100315.593171:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877056140892800:12345-0@lo:400: 00000100:00100000:3.0:1790100315.593193:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877056140892800:12345-0@lo:400: Request processed in 23us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100315.593198:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100315.593208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100315.593213:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140892928:12345-0@lo:400: 00000100:00100000:3.0:1790100315.593237:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140892928:12345-0@lo:400: Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100315.593243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100315.593259:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140892416 00000100:00100000:3.0:1790100315.593262:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140892416 00000100:00100000:3.0:1790100315.593283:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140892672 00000100:00100000:3.0:1790100315.593286:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140892672 00000100:00100000:3.0:1790100315.593296:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790100315.593302:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140892416:12345-0@lo:400: 00000100:00100000:3.0:1790100315.593364:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140892416:12345-0@lo:400: Request processed in 62us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100315.593372:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790100315.593386:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100315.593392:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140892672:12345-0@lo:400: 00000100:00100000:3.0:1790100315.593422:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140892672:12345-0@lo:400: Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100315.593424:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140892160 00000100:00100000:3.0:1790100315.593429:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790100315.593436:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140892160 00000100:00100000:3.0:1790100315.593472:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140892416:0@lo:400: 00010000:00080000:3.0:1790100315.593485:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926082133100 x1877056140892928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100315.593496:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140892928:0@lo:400: 00010000:00080000:3.0:1790100315.593507:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926082133800 x1877056140892544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100315.593513:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790100315.593523:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140892544:0@lo:400: 00000100:00100000:2.0:1790100315.593526:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:3644:x1877056140892160:12345-0@lo:400: 00000100:00100000:2.0:1790100315.593564:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:3644:x1877056140892160:12345-0@lo:400: Request processed in 41us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100315.593571:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1790100315.593653:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100315.593657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100315.593676:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140892160:0@lo:400: 00000100:00100000:2.0:1790100315.593688:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140892672:0@lo:400: 00010000:00080000:2.0:1790100315.593700:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926082130380 x1877056140892288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100315.593709:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056140892288:0@lo:400: 00010000:00080000:2.0:1790100315.593722:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926082132d80 x1877056140892800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100315.593730:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056140892800:0@lo:400: 00010000:00010000:2.0:1790100315.976752:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100317.001501:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790100317.536198:0:8946:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100317.536468:0:8946:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1790100317.642404:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790100317.642412:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b2026000 from 30 10000000:01000000:3.0:1790100317.642417:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790100317.642458:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.642469:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.642479:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100317.642510:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893056:0@lo:101: 00000100:00100000:3.0:1790100317.642568:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100317.642608:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.649006:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140893056 00000100:00100000:0.0:1790100317.649020:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140893056 00000100:00100000:0.0:1790100317.649079:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790100317.649090:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140893056:12345-0@lo:101: 00010000:00010000:0.0:1790100317.649106:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100317.649124:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828693b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.649150:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828693b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.649167:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828693b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.649186:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e58200, rc 0) 00000100:00100000:0.0:1790100317.649255:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140893056:12345-0@lo:101: Request processed in 167us (6686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.649263:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790100317.649322:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893056:0@lo:101: 00010000:00010000:0.0:1790100317.649355:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.649366:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100317.649434:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893184:0@lo:501: 00000100:00100000:0.0:1790100317.649463:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.649491:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261933bcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.649505:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140893184 00000100:00100000:0.0:1790100317.649509:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140893184 00000100:00100000:0.0:1790100317.649535:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790100317.649540:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140893184:12345-0@lo:501: 00000100:00100000:0.0:1790100317.649661:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140893184:12345-0@lo:501: Request processed in 119us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.649667:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790100317.649859:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893184:0@lo:501: 00000100:00100000:1.0:1790100317.649888:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893312:0@lo:503: 00000100:00100000:1.0:1790100317.649943:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.649965:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.650102:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140893312 00000100:00100000:0.0:1790100317.650107:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140893312 00000100:00100000:0.0:1790100317.650139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790100317.650146:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140893312:12345-0@lo:503: 00000100:00100000:0.0:1790100317.650224:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140893312:12345-0@lo:503: Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.650235:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790100317.650270:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893312:0@lo:503: 00000100:00100000:0.0:1790100317.650450:0:8958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8958:1877056140893440:0@lo:502: 00000100:00100000:0.0:1790100317.650484:0:8958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.650501:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140893440 00000100:00100000:0.0:1790100317.650505:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140893440 00000100:00100000:0.0:1790100317.650524:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790100317.650530:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:8958:x1877056140893440:12345-0@lo:502: 00000100:00100000:0.0:1790100317.650594:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:8958:x1877056140893440:12345-0@lo:502: Request processed in 64us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.650600:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790100317.650627:0:8958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.650639:0:8958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8958:1877056140893440:0@lo:502: 00000100:00100000:0.0:1790100317.650673:0:8958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8958:1877056140893568:0@lo:502: 00000100:00100000:0.0:1790100317.650704:0:8958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.650721:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140893568 00000100:00100000:0.0:1790100317.650724:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140893568 00000100:00100000:0.0:1790100317.650742:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790100317.650747:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:8958:x1877056140893568:12345-0@lo:502: 00000100:00100000:0.0:1790100317.650800:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:8958:x1877056140893568:12345-0@lo:502: Request processed in 52us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.650806:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790100317.650831:0:8958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.650843:0:8958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8958:1877056140893568:0@lo:502: 00000040:00080000:0.0:1790100317.650860:0:8958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790100317.650906:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790100317.651851:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100317.651862:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.651872:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100317.651880:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790100317.651882:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9261b2026000 from 5 10000000:01000000:0.0:1790100317.651885:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100317.653053:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.653066:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.653077:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100317.653097:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893696:0@lo:101: 00000100:00100000:0.0:1790100317.653152:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.653190:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100317.653896:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140893696 00000100:00100000:3.0:1790100317.653904:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140893696 00000100:00100000:3.0:1790100317.654075:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790100317.654084:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140893696:12345-0@lo:101: 00010000:00010000:3.0:1790100317.654097:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100317.654112:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286949 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.654135:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286949 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.654145:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286949 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.654154:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565dc00, rc 0) 00000100:00100000:3.0:1790100317.654197:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140893696:12345-0@lo:101: Request processed in 114us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100317.654205:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790100317.654309:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893696:0@lo:101: 00010000:00010000:0.0:1790100317.654323:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.654332:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100317.654411:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893824:0@lo:256: 00000100:00100000:0.0:1790100317.654442:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.654462:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100317.654710:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140893824 00000100:00100000:3.0:1790100317.654716:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140893824 00000100:00100000:3.0:1790100317.654744:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790100317.654751:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140893824:12345-0@lo:256: 20000000:01000000:3.0:1790100317.654765:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790100317.654780:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790100317.654787:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1790100317.654855:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140893824:12345-0@lo:256: Request processed in 103us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100317.654862:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790100317.656098:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893824:0@lo:256: 10000000:01000000:0.0:1790100317.656153:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100317.656162:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.656171:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100317.656180:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1790100317.656182:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1790100317.656185:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790100317.656211:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.656218:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.656226:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100317.656241:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893952:0@lo:101: 00000100:00100000:0.0:1790100317.656281:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.656310:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182e13900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.656327:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140893952 00000100:00100000:0.0:1790100317.656358:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140893952 00000100:00100000:0.0:1790100317.656395:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790100317.656402:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140893952:12345-0@lo:101: 00010000:00010000:0.0:1790100317.656412:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100317.656421:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286957 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.656439:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286957 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.656450:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286957 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.656457:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e59800, rc 0) 00000100:00100000:0.0:1790100317.656487:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140893952:12345-0@lo:101: Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.656494:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790100317.656529:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140893952:0@lo:101: 00010000:00010000:0.0:1790100317.656539:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.656548:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100317.656596:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140894080:0@lo:501: 00000100:00100000:0.0:1790100317.656619:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.656632:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182e13900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.656643:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140894080 00000100:00100000:0.0:1790100317.656646:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140894080 00000100:00100000:0.0:1790100317.656674:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790100317.656679:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140894080:12345-0@lo:501: 00000100:00100000:0.0:1790100317.656787:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140894080:12345-0@lo:501: Request processed in 107us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.656793:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790100317.656821:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140894080:0@lo:501: 00000100:00100000:0.0:1790100317.656844:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140894208:0@lo:503: 00000100:00100000:0.0:1790100317.656881:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.656895:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182e13900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.656906:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140894208 00000100:00100000:0.0:1790100317.656909:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140894208 00000100:00100000:0.0:1790100317.660135:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790100317.660146:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140894208:12345-0@lo:503: 00000100:00100000:0.0:1790100317.660281:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140894208:12345-0@lo:503: Request processed in 136us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.660289:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790100317.662383:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140894208:0@lo:503: 00000100:00100000:0.0:1790100317.664456:0:8959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8959:1877056140894336:0@lo:502: 00000100:00100000:0.0:1790100317.664532:0:8959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.664569:0:8959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261909a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.664744:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140894336 00000100:00100000:1.0:1790100317.664751:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140894336 00000100:00100000:1.0:1790100317.664796:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790100317.664805:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:8959:x1877056140894336:12345-0@lo:502: 00000100:00100000:1.0:1790100317.665649:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:8959:x1877056140894336:12345-0@lo:502: Request processed in 843us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.665659:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790100317.666720:0:8959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8959:1877056140894336:0@lo:502: 00000020:01000000:2.0:1790100317.666755:0:8959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790100317.666763:0:8959:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790100317.666770:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100317.666772:0:8959:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790100317.666778:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790100317.666782:0:8959:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1790100317.666803:0:8959:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790100317.666814:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790100317.666827:0:8959:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9261b5ab4d40) 00000020:00000080:2.0:1790100317.666847:0:8959:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1790100317.666854:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790100317.666945:0:8959:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1790100317.666952:0:8959:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790100317.666958:0:8959:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f229828696c 00010000:00080000:2.0:1790100317.667098:0:8959:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261b2024800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790100317.667318:0:8959:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1790100317.678818:0:8959:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790100317.678844:0:8959:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790100317.679697:0:8959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100317.680265:0:8959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100317.680453:0:8959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1790100317.680554:0:8959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790100317.681175:0:8960:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100317.681180:0:8960:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790100317.681909:0:8959:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790100317.682042:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100317.682084:0:8959:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790100317.682106:0:8959:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298286973 00000100:00080000:0.0:1790100317.682116:0:8959:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100317.682128:0:8959:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9261b2024800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100317.682166:0:8959:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261c197ea00 x1877056140894464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790100317.682235:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056140894464:0@lo:8: 00000100:00100000:3.0:1790100317.682295:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790100317.682486:0:8959:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790100317.682544:0:8959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100317.682548:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100317.682550:0:8959:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790100317.682553:0:8959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100317.682557:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100317.682559:0:8959:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790100317.682561:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790100317.682563:0:8959:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790100317.682586:0:8959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8959:1877056140894592:0@lo:502: 00000100:00100000:0.0:1790100317.682626:0:8959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.682653:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140894592 00000100:00100000:0.0:1790100317.682659:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140894592 00000100:00100000:0.0:1790100317.682693:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790100317.682702:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:8959:x1877056140894592:12345-0@lo:502: 00000100:00100000:0.0:1790100317.682800:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:8959:x1877056140894592:12345-0@lo:502: Request processed in 99us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.682807:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790100317.682846:0:8959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a62b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.682864:0:8959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8959:1877056140894592:0@lo:502: 00000020:01000000:0.0:1790100317.682886:0:8959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100317.682890:0:8959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100317.682892:0:8959:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790100317.682895:0:8959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:2.0:1790100317.683128:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140894464 00000100:00100000:2.0:1790100317.683134:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140894464 00000100:00100000:2.0:1790100317.683157:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100317.683162:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1877056140894464:12345-0@lo:8: 00010000:00080000:2.0:1790100317.683183:0:8425:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1790100317.683205:0:8425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f229828697a 00002000:00100000:2.0:1790100317.683234:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9261a613e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790100317.683239:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1790100317.683243:0:8425:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790100317.683291:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790100317.683496:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790100317.683518:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9261a613b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100317.683917:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140895104:0@lo:400: 00000100:00100000:1.0:1790100317.683950:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.683989:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790100317.684003:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140894720:0@lo:400: 00000100:00100000:1.0:1790100317.684028:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.684046:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140895232:0@lo:400: 00000100:00100000:1.0:1790100317.684067:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.684089:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140894848:0@lo:400: 00000100:00100000:1.0:1790100317.684110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.684125:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140895360:0@lo:400: 00000100:00100000:1.0:1790100317.684146:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.684160:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100317.684165:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140894976:0@lo:400: 00000100:00100000:1.0:1790100317.684184:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.684205:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140894720 00000100:00100000:1.0:1790100317.684209:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140894720 00000100:00100000:1.0:1790100317.684230:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140895232 00000100:00100000:1.0:1790100317.684232:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140895232 00000100:00100000:1.0:1790100317.684252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140895360 00000100:00100000:1.0:1790100317.684254:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140895360 00000100:00100000:1.0:1790100317.684264:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140894976 00000100:00100000:1.0:1790100317.684266:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140894976 00000100:00100000:1.0:1790100317.684278:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790100317.684285:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140894720:12345-0@lo:400: 00000100:00100000:1.0:1790100317.684321:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140894720:12345-0@lo:400: Request processed in 35us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.684327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790100317.684367:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100317.684374:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140895232:12345-0@lo:400: 00000100:00100000:1.0:1790100317.684400:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140895232:12345-0@lo:400: Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.684412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100317.684424:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100317.684430:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140895360:12345-0@lo:400: 00000100:00100000:1.0:1790100317.684462:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140895360:12345-0@lo:400: Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.684467:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100317.684478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100317.684484:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140894976:12345-0@lo:400: 00000100:00100000:1.0:1790100317.684509:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140894976:12345-0@lo:400: Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.684514:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1790100317.684532:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100317.684536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790100317.684556:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92618683ea00 x1877056140894720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.684568:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140894720:0@lo:400: 00010000:00080000:1.0:1790100317.684577:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79ee680 x1877056140895232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.684584:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140895232:0@lo:400: 00010000:00080000:1.0:1790100317.684613:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92618683d180 x1877056140894976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.684621:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140894976:0@lo:400: 00010000:00080000:1.0:1790100317.684629:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79ed500 x1877056140895360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.684648:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140895360:0@lo:400: 00000020:01000000:1.0:1790100317.684666:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1790100317.684686:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790100317.684695:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.684706:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100317.684716:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790100317.684718:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926187007800 from 30 10000000:01000000:1.0:1790100317.684720:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100317.684741:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.684749:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.684758:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100317.684770:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140895488:0@lo:101: 00000100:00100000:1.0:1790100317.684796:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.684818:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.684831:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140895488 00000100:00100000:1.0:1790100317.684834:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140895488 00000100:00100000:1.0:1790100317.684856:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790100317.684862:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140895488:12345-0@lo:101: 00010000:00010000:1.0:1790100317.684877:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100317.684888:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286981 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.684907:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286981 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.684916:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286981 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.684924:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189917600, rc 0) 00000100:00100000:1.0:1790100317.684951:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140895488:12345-0@lo:101: Request processed in 89us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.684956:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790100317.685000:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140895488:0@lo:101: 00010000:00010000:1.0:1790100317.685012:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.685020:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100317.685071:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140895616:0@lo:501: 00000100:00100000:1.0:1790100317.685095:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.685107:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.685118:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140895616 00000100:00100000:1.0:1790100317.685122:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140895616 00000100:00100000:1.0:1790100317.685142:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790100317.685148:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140895616:12345-0@lo:501: 00000100:00100000:1.0:1790100317.685250:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140895616:12345-0@lo:501: Request processed in 101us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.685257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790100317.685284:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140895616:0@lo:501: 00000100:00100000:1.0:1790100317.685307:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140895744:0@lo:503: 00000100:00100000:1.0:1790100317.685360:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.685377:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.685388:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140895744 00000100:00100000:1.0:1790100317.685391:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140895744 00000100:00100000:1.0:1790100317.685409:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790100317.685415:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140895744:12345-0@lo:503: 00000100:00100000:1.0:1790100317.685481:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140895744:12345-0@lo:503: Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.685487:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790100317.685523:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140895744:0@lo:503: 00000100:00100000:3.0:1790100317.685830:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140895104 00000100:00100000:3.0:1790100317.685836:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140895104 00000100:00100000:3.0:1790100317.686085:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140894848 00000100:00100000:3.0:1790100317.686129:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140894848 00000100:00100000:3.0:1790100317.686149:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100317.686156:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140895104:12345-0@lo:400: 00000100:00100000:1.0:1790100317.686246:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790100317.686254:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140894848:12345-0@lo:400: 00000100:00100000:1.0:1790100317.686290:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140894848:12345-0@lo:400: Request processed in 37us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.686297:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790100317.686325:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140894848:0@lo:400: 00000100:00100000:3.0:1790100317.686397:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140895104:12345-0@lo:400: Request processed in 241us (2445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100317.686403:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790100317.686494:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1877056140894464:12345-0@lo:8: Request processed in 3330us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.686503:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100317.686606:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140895104:0@lo:400: 00000100:00100000:2.0:1790100317.686846:0:8962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8962:1877056140895872:0@lo:502: 00000100:00100000:2.0:1790100317.686999:0:8962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.687032:0:8962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261909a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.687056:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140895872 00000100:00100000:1.0:1790100317.687061:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140895872 00000100:00100000:1.0:1790100317.687092:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100317.687100:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:8962:x1877056140895872:12345-0@lo:502: 00000100:00100000:1.0:1790100317.687197:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:8962:x1877056140895872:12345-0@lo:502: Request processed in 98us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.687205:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790100317.687445:0:8962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8962:1877056140895872:0@lo:502: 00000100:00100000:2.0:1790100317.687485:0:8962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8962:1877056140896000:0@lo:502: 00000100:00100000:2.0:1790100317.687517:0:8962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.687612:0:8962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b79119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.687650:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140896000 00000100:00100000:1.0:1790100317.687655:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140896000 00000100:00100000:1.0:1790100317.687715:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790100317.687722:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:8962:x1877056140896000:12345-0@lo:502: 00000100:00100000:1.0:1790100317.687787:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:8962:x1877056140896000:12345-0@lo:502: Request processed in 66us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.687794:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1790100317.688000:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c197ea00 x1877056140894464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100317.688011:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100317.688018:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1790100317.688025:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790100317.688030:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790100317.688033:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2024800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790100317.688045:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790100317.688051:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056140894464:0@lo:8: 00000100:00100000:3.0:1790100317.689239:0:8961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8961:1877056140896128:0@lo:700: 00000100:00100000:3.0:1790100317.689281:0:8961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100317.689305:0:8961:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a62339c0 going to sleep for 11 seconds 00000004:00080000:2.0:1790100317.689486:0:8960:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790100317.689548:0:8960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 168977208259ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790100317.689554:0:8960:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790100317.689584:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140896128 00000100:00100000:2.0:1790100317.689589:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140896128 00000100:00100000:2.0:1790100317.689630:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100317.689637:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8961:x1877056140896128:12345-0@lo:700: 00000100:00100000:2.0:1790100317.689667:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8433:1877056140896256:0@lo:700: 00000100:00100000:2.0:1790100317.689694:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.689711:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261909a1780 going to sleep for 11 seconds 00000100:00080000:1.0:1790100317.691711:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100317.691797:0:8962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8962:1877056140896000:0@lo:502: 00000040:00080000:1.0:1790100317.691838:0:8962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790100317.692085:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790100317.692110:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790100317.692121:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.692132:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100317.692140:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790100317.692305:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926187007800 from 5 10000000:01000000:1.0:1790100317.692309:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100317.692360:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.692368:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.692385:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100317.692403:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896384:0@lo:101: 00000100:00100000:1.0:1790100317.692458:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.692489:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.692507:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140896384 00000100:00100000:1.0:1790100317.692512:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140896384 00000100:00100000:1.0:1790100317.692551:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790100317.692560:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140896384:12345-0@lo:101: 00010000:00010000:1.0:1790100317.692571:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100317.692582:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828698f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.692604:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828698f expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.692614:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828698f expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.692623:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189917400, rc 0) 00000100:00100000:1.0:1790100317.692661:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140896384:12345-0@lo:101: Request processed in 102us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.692667:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790100317.692736:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896384:0@lo:101: 00010000:00010000:1.0:1790100317.692749:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.692767:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100317.692811:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896512:0@lo:256: 00000100:00100000:1.0:1790100317.692841:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.692854:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.693118:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140896512 00000100:00100000:1.0:1790100317.693123:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140896512 00000100:00100000:1.0:1790100317.693252:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790100317.693261:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140896512:12345-0@lo:256: 20000000:01000000:1.0:1790100317.693274:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790100317.693289:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790100317.693292:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1790100317.693411:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140896512:12345-0@lo:256: Request processed in 152us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.693418:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790100317.693770:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896512:0@lo:256: 10000000:01000000:3.0:1790100317.693820:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790100317.693827:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.693838:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100317.693846:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790100317.693849:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1790100317.693852:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790100317.693870:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.693877:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.693884:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100317.693896:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896640:0@lo:101: 00000100:00100000:3.0:1790100317.693931:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100317.693957:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.694035:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140896640 00000100:00100000:1.0:1790100317.694040:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140896640 00000100:00100000:0.0:1790100317.694184:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140896256 00000100:00100000:0.0:1790100317.694195:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140896256 00000100:00100000:0.0:1790100317.694226:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100317.694233:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8433:x1877056140896256:12345-0@lo:700: 00000100:00100000:1.0:1790100317.694268:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790100317.694278:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140896640:12345-0@lo:101: 00010000:00010000:1.0:1790100317.694286:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100317.694297:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f229828699d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.694315:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f229828699d expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.694335:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828699d expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100317.694364:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189916c00, rc 0) 00000100:00100000:1.0:1790100317.694400:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140896640:12345-0@lo:101: Request processed in 124us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.694406:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790100317.694420:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896640:0@lo:101: 00010000:00010000:3.0:1790100317.694434:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.694444:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100317.694503:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896768:0@lo:501: 00000100:00100000:3.0:1790100317.694530:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.694554:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140896768 00000100:00100000:3.0:1790100317.694557:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.694559:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140896768 00000100:00100000:1.0:1790100317.694587:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790100317.694594:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140896768:12345-0@lo:501: 00000100:00100000:1.0:1790100317.695408:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140896768:12345-0@lo:501: Request processed in 813us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.695416:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000004:00080000:0.0:1790100317.698454:0:7441:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:0.0:1790100317.699279:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1790100317.701114:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896768:0@lo:501: 00000100:00100000:3.0:1790100317.701170:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896896:0@lo:503: 00000100:00100000:3.0:1790100317.701242:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100317.701282:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.702106:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140896896 00000100:00100000:1.0:1790100317.702114:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140896896 00000100:00100000:1.0:1790100317.702157:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790100317.702166:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140896896:12345-0@lo:503: 00000100:00100000:1.0:1790100317.702288:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140896896:12345-0@lo:503: Request processed in 123us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.702297:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790100317.702364:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140896896:0@lo:503: 00000100:00100000:1.0:1790100317.704820:0:8964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8964:1877056140897024:0@lo:502: 00000100:00100000:1.0:1790100317.704888:0:8964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.704919:0:8964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd240 going to sleep for 11 seconds 00000100:00100000:3.0:1790100317.704946:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140897024 00000100:00100000:3.0:1790100317.704955:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140897024 00000100:00100000:3.0:1790100317.705013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790100317.705023:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:8964:x1877056140897024:12345-0@lo:502: 00000100:00100000:3.0:1790100317.705138:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:8964:x1877056140897024:12345-0@lo:502: Request processed in 116us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100317.705156:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790100317.705164:0:8964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8964:1877056140897024:0@lo:502: 00000020:01000000:1.0:1790100317.705191:0:8964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790100317.705198:0:8964:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790100317.705205:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100317.705208:0:8964:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790100317.705212:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790100317.705216:0:8964:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1790100317.705235:0:8964:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790100317.705238:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100317.705252:0:8964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9261b69a8000) 00000020:00000080:1.0:1790100317.705272:0:8964:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1790100317.705277:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790100317.705400:0:8964:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790100317.705405:0:8964:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790100317.705411:0:8964:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f22982869b2 00010000:00080000:1.0:1790100317.705437:0:8964:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261a62fd800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790100317.705636:0:8964:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1790100317.707650:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8433:x1877056140896256:12345-0@lo:700: Request processed in 13412us (17949us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.707663:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790100317.707736:0:8433:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1981f80 x1877056140896256/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100317.707750:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8433:1877056140896256:0@lo:700: 40000000:02000000:3.0:1790100317.707762:0:8433:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1790100317.709969:0:8964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790100317.709999:0:8964:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790100317.710173:0:8964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100317.710323:0:8964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100317.710433:0:8964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790100317.710508:0:8964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1790100317.711184:0:8965:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100317.711189:0:8965:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790100317.713993:0:8964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790100317.714009:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790100317.714055:0:8964:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790100317.714078:0:8964:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f22982869b9 00000100:00080000:2.0:1790100317.714087:0:8964:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790100317.714099:0:8964:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9261a62fd800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100317.714131:0:8964:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261c1980e00 x1877056140897152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100317.714172:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056140897152:0@lo:8: 00000100:00100000:2.0:1790100317.714230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790100317.714287:0:8964:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1790100317.714398:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140897152 00000100:00100000:1.0:1790100317.714406:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140897152 00000100:00100000:2.0:1790100317.714412:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140897280:0@lo:400: 00000100:00100000:2.0:1790100317.714453:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.714454:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100317.714465:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1877056140897152:12345-0@lo:8: 00000100:00100000:2.0:1790100317.714481:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140897792:0@lo:400: 00010000:00080000:1.0:1790100317.714491:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000100:00100000:2.0:1790100317.714507:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1790100317.714519:0:8427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f22982869c0 00000100:00100000:2.0:1790100317.714529:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00002000:00100000:1.0:1790100317.714535:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9261a62fc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1790100317.714537:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140897664:0@lo:400: 00002000:00080000:1.0:1790100317.714543:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1790100317.714548:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1790100317.714564:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.714580:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140898176:0@lo:400: 00000100:00100000:2.0:1790100317.714605:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1790100317.714616:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1790100317.714634:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140897536:0@lo:400: 00000100:00080000:1.0:1790100317.714640:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9261a62f8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100317.714668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.714692:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140898048:0@lo:400: 00000100:00100000:1.0:1790100317.714704:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1877056140897152:12345-0@lo:8: Request processed in 238us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.714712:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100317.714727:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140898176 00000100:00100000:2.0:1790100317.714730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.714733:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140898176 00000100:00100000:2.0:1790100317.714758:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790100317.714759:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100317.714771:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140897408:0@lo:400: 00000100:00100000:1.0:1790100317.714771:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1877056140898176:12345-0@lo:400: 00000100:00100000:2.0:1790100317.714803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.714822:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140897920:0@lo:400: 00000100:00100000:1.0:1790100317.714828:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1877056140898176:12345-0@lo:400: Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.714837:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100317.714847:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.714859:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140897792 00000100:00100000:1.0:1790100317.714864:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140897792 00000100:00100000:2.0:1790100317.714881:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140897664 00000100:00100000:2.0:1790100317.714886:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140897664 00000100:00100000:1.0:1790100317.714888:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140897536 00000100:00100000:1.0:1790100317.714893:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140897536 00000100:00100000:2.0:1790100317.714919:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140898048 00000100:00100000:2.0:1790100317.714924:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140898048 00000100:00100000:1.0:1790100317.714928:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790100317.714937:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140897792:12345-0@lo:400: 00000100:00100000:2.0:1790100317.714951:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140897408 00000100:00100000:2.0:1790100317.714956:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140897408 00000100:00100000:2.0:1790100317.714970:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140897920 00000100:00100000:2.0:1790100317.714982:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140897920 00000100:00100000:2.0:1790100317.714997:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100317.715002:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140897664:12345-0@lo:400: 00000100:00100000:1.0:1790100317.715756:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140897792:12345-0@lo:400: Request processed in 819us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.715764:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790100317.715789:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100317.715796:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140897536:12345-0@lo:400: 00000100:00100000:2.0:1790100317.715851:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140897664:12345-0@lo:400: Request processed in 846us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.715859:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100317.715875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100317.715882:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140898048:12345-0@lo:400: 00000100:00100000:2.0:1790100317.715916:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140898048:12345-0@lo:400: Request processed in 35us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.715922:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100317.715934:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100317.716052:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140897408:12345-0@lo:400: 00000100:00100000:2.0:1790100317.716104:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140897408:12345-0@lo:400: Request processed in 163us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.716111:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100317.716124:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100317.716131:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140897920:12345-0@lo:400: 00000100:00100000:2.0:1790100317.716157:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140897920:12345-0@lo:400: Request processed in 27us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.716162:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1790100317.716197:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1981c00 x1877056140897408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100317.716372:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140897408:0@lo:400: 00010000:00080000:2.0:1790100317.716395:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1982300 x1877056140897920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100317.716404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140897920:0@lo:400: 00010000:00080000:2.0:1790100317.716417:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b8eef480 x1877056140898048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100317.716426:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140898048:0@lo:400: 00000020:01000000:2.0:1790100317.716583:0:8964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100317.716590:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100317.716592:0:8964:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790100317.716596:0:8964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100317.716600:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100317.716601:0:8964:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790100317.716604:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790100317.716607:0:8964:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790100317.716634:0:8964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8964:1877056140898304:0@lo:502: 00000100:00100000:2.0:1790100317.716679:0:8964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.716707:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140897280 00000100:00100000:2.0:1790100317.716712:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140897280 00000100:00100000:2.0:1790100317.716746:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140898304 00000100:00100000:2.0:1790100317.716749:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140898304 00000100:00100000:2.0:1790100317.716761:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790100317.716767:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:3644:x1877056140897280:12345-0@lo:400: 00000100:00100000:2.0:1790100317.716799:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:3644:x1877056140897280:12345-0@lo:400: Request processed in 33us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.716805:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790100317.716825:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790100317.716833:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:8964:x1877056140898304:12345-0@lo:502: 00000100:00100000:2.0:1790100317.717068:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:8964:x1877056140898304:12345-0@lo:502: Request processed in 111us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.717075:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790100317.717117:0:8964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261909a10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100317.717130:0:8964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:8964:1877056140898304:0@lo:502: 00000020:01000000:2.0:1790100317.717151:0:8964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100317.717155:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100317.717157:0:8964:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790100317.717161:0:8964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1790100317.717711:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140897536:12345-0@lo:400: Request processed in 1913us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.717719:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1790100317.717758:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1981880 x1877056140897664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.717768:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140897664:0@lo:400: 00010000:00080000:1.0:1790100317.717783:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b8eeca80 x1877056140898176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.717790:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140898176:0@lo:400: 00000100:00100000:1.0:1790100317.717798:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140897280:0@lo:400: 00000100:00100000:1.0:1790100317.717807:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140897792:0@lo:400: 00010000:00080000:1.0:1790100317.717847:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1980e00 x1877056140897152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.717854:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790100317.717861:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790100317.717868:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790100317.717872:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790100317.717876:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a62fd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790100317.717887:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790100317.717891:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056140897152:0@lo:8: 00000004:00080000:1.0:1790100317.718013:0:8965:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790100317.718068:0:8965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 169005728245ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790100317.718091:0:8965:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1790100317.718427:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140897536:0@lo:400: 00000004:00080000:1.0:1790100317.720599:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:01000000:3.0:1790100317.721464:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1790100317.721490:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790100317.721500:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.721511:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100317.721531:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790100317.721533:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9261b2304d40 from 1 10000000:01000000:3.0:1790100317.721535:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790100317.721566:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.721574:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.721583:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100317.721604:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140898432:0@lo:101: 00000100:00100000:3.0:1790100317.721665:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100317.721696:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a62333c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100317.722036:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140898432 00000100:00100000:2.0:1790100317.722043:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140898432 00000100:00100000:2.0:1790100317.722089:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790100317.722097:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140898432:12345-0@lo:101: 00010000:00010000:2.0:1790100317.722109:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100317.722120:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982869c7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100317.722141:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100317.722152:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100317.722159:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030a00, rc 0) 00000100:00100000:2.0:1790100317.722206:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140898432:12345-0@lo:101: Request processed in 110us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.722212:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790100317.722496:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140898432:0@lo:101: 00010000:00010000:0.0:1790100317.722511:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100317.722520:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100317.722578:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140898560:0@lo:501: 00000100:00100000:0.0:1790100317.722606:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.722625:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cce900 going to sleep for 11 seconds 00000100:00100000:3.0:1790100317.722673:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140898560 00000100:00100000:3.0:1790100317.722678:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140898560 00000100:00100000:3.0:1790100317.722709:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790100317.722716:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140898560:12345-0@lo:501: 00000100:00100000:3.0:1790100317.722782:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140898560:12345-0@lo:501: Request processed in 66us (176us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790100317.722790:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790100317.723145:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140898560:0@lo:501: 10000000:01000000:3.0:1790100317.723192:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790100317.723198:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100317.723218:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1790100317.723897:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1790100317.723904:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1790100317.725132:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8961:x1877056140896128:12345-0@lo:700: Request processed in 35491us (35847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.725147:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790100317.725270:0:8961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a636b480 x1877056140896128/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100317.725284:0:8961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8961:1877056140896128:0@lo:700: 00000100:00100000:3.0:1790100317.725603:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140898688:0@lo:13: 00000100:00100000:3.0:1790100317.725640:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.725702:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140898688 00000100:00100000:0.0:1790100317.725708:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140898688 00000100:00100000:0.0:1790100317.725759:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100317.725767:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140898688:12345-0@lo:13: 00002000:00000024:0.0:1790100317.725789:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000004:00080000:2.0:1790100317.725845:0:8966:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790100317.725864:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8966:1877056140898816:0@lo:7: 00000100:00100000:2.0:1790100317.725890:0:8966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.725906:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.725967:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140898688:12345-0@lo:13: Request processed in 200us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.726042:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790100317.726062:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790100317.726104:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b40380 x1877056140898688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100317.726119:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140898688:0@lo:13: 00000100:00100000:1.0:1790100317.726167:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140898816 00000100:00100000:1.0:1790100317.726172:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140898816 00000100:00100000:1.0:1790100317.726204:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100317.726212:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8966:x1877056140898816:12345-0@lo:7: 00002000:00080000:1.0:1790100317.731357:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1790100317.731366:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1790100317.731861:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8966:x1877056140898816:12345-0@lo:7: Request processed in 5646us (5965us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.731871:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790100317.732095:0:8966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b40e00 x1877056140898816/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100317.732109:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8966:1877056140898816:0@lo:7: 00000004:00080000:2.0:1790100317.732122:0:8966:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790100317.732159:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8966:1877056140898944:0@lo:5: 00000100:00100000:2.0:1790100317.732193:0:8966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.732223:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140898944 00000100:00100000:2.0:1790100317.732229:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140898944 00000100:00100000:2.0:1790100317.732261:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100317.732269:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8966:x1877056140898944:12345-0@lo:5: 00002000:00080000:2.0:1790100317.732290:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790100317.732293:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790100317.732885:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8966:x1877056140898944:12345-0@lo:5: Request processed in 615us (689us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790100317.732892:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100317.732912:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c10c0 going to sleep for 11 seconds 00010000:00080000:2.0:1790100317.732925:0:8966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b40e00 x1877056140898944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100317.732936:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8966:1877056140898944:0@lo:5: 00000004:00080000:2.0:1790100317.732944:0:8966:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790100317.734655:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8966:1877056140899072:0@lo:700: 00000100:00100000:2.0:1790100317.734707:0:8966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.734745:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.735063:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140899072 00000100:00100000:0.0:1790100317.735070:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140899072 00000100:00100000:0.0:1790100317.735106:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100317.735114:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8966:x1877056140899072:12345-0@lo:700: 00000004:00080000:3.0:1790100317.736166:0:8961:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790100317.736187:0:8961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8961:1877056140899328:0@lo:7: 00000100:00100000:3.0:1790100317.736230:0:8961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100317.736264:0:8961:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a62339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100317.736313:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140899200:0@lo:13: 00000100:00100000:0.0:1790100317.736362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.736394:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140899200 00000100:00100000:0.0:1790100317.736399:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140899200 00000100:00100000:0.0:1790100317.736430:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100317.736437:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140899200:12345-0@lo:13: 00002000:00000024:0.0:1790100317.736452:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1790100317.736491:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140899200:12345-0@lo:13: Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.736498:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790100317.736537:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a636a680 x1877056140899200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100317.736554:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140899200:0@lo:13: 00000100:00100000:1.0:1790100317.736786:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140899328 00000100:00100000:1.0:1790100317.736791:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140899328 00000100:00100000:1.0:1790100317.736900:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100317.736908:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8961:x1877056140899328:12345-0@lo:7: 00000001:00080000:3.0:1790100317.739214:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1790100317.739442:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8966:x1877056140899072:12345-0@lo:700: Request processed in 4325us (4731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.739454:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790100317.740513:0:8966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b42a00 x1877056140899072/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100317.740525:0:8966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790100317.740541:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8966:1877056140899072:0@lo:700: 00002000:00080000:1.0:1790100317.741784:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790100317.741790:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790100317.741854:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8961:x1877056140899328:12345-0@lo:7: Request processed in 4944us (5620us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.741863:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790100317.743105:0:8961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6369500 x1877056140899328/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100317.743120:0:8961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8961:1877056140899328:0@lo:7: 00000004:00080000:3.0:1790100317.743140:0:8961:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790100317.743173:0:8961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8961:1877056140899456:0@lo:5: 00000100:00100000:3.0:1790100317.743211:0:8961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100317.743251:0:8961:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a62339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100317.743265:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140899456 00000100:00100000:2.0:1790100317.743276:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140899456 00000100:00100000:2.0:1790100317.743360:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100317.743370:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8961:x1877056140899456:12345-0@lo:5: 00002000:00080000:2.0:1790100317.743394:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1790100317.743432:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8961:x1877056140899456:12345-0@lo:5: Request processed in 63us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.743595:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790100317.743625:0:8961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6369500 x1877056140899456/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100317.743635:0:8961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8961:1877056140899456:0@lo:5: 00000004:00080000:2.0:1790100317.743643:0:8961:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790100317.743666:0:8961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8961:1877056140899584:0@lo:5: 00000100:00100000:2.0:1790100317.743688:0:8961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.743710:0:8961:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.743740:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140899584 00000100:00100000:1.0:1790100317.743745:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140899584 00000100:00100000:1.0:1790100317.743778:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100317.743785:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8961:x1877056140899584:12345-0@lo:5: 00002000:00080000:1.0:1790100317.743807:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1790100317.745775:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8961:x1877056140899584:12345-0@lo:5: Request processed in 1985us (2080us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790100317.745784:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790100317.745827:0:8961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b41f80 x1877056140899584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.745848:0:8961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8961:1877056140899584:0@lo:5: 00000004:00080000:1.0:1790100317.745862:0:8961:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1790100317.745894:0:8961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8961:1877056140899712:0@lo:900: 00000100:00100000:1.0:1790100317.745924:0:8961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.745943:0:8961:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261862ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1790100317.745965:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140899712 00000100:00100000:1.0:1790100317.745970:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140899712 00000100:00100000:1.0:1790100317.746014:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100317.746022:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8961:x1877056140899712:12345-0@lo:900: 00000100:00100000:1.0:1790100317.746062:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8961:x1877056140899712:12345-0@lo:900: Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.746068:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790100317.746094:0:8961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79ee680 x1877056140899712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.746103:0:8961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8961:1877056140899712:0@lo:900: 00000004:02000040:2.0:1790100317.746627:0:8966:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1790100317.752205:0:8966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8966:1877056140899840:0@lo:5: 00000100:00100000:2.0:1790100317.752264:0:8966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100317.752298:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140899840 00000100:00100000:2.0:1790100317.752305:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140899840 00000100:00100000:2.0:1790100317.752364:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100317.752372:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8966:x1877056140899840:12345-0@lo:5: 00000100:00100000:3.0:1790100317.753408:0:8966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c10c0 going to sleep for 11 seconds 00002000:00080000:2.0:1790100317.756572:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1790100317.756591:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1790100317.758318:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8966:x1877056140899840:12345-0@lo:5: Request processed in 5941us (6048us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790100317.758329:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790100317.758431:0:8966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b43480 x1877056140899840/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100333 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100317.758447:0:8966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8966:1877056140899840:0@lo:5: 00000004:00080000:3.0:1790100317.758461:0:8966:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1790100318.024624:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100318.152449:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100318.152471:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140899968:0@lo:41: 00000100:00100000:0.0:1790100318.152524:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100318.152588:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140899968 00000100:00100000:0.0:1790100318.152595:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140899968 00000100:00100000:0.0:1790100318.152631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790100318.152639:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140899968:12345-0@lo:41: 00000004:00000024:0.0:1790100318.152671:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1790100318.152710:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140899968:12345-0@lo:41: Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100318.152717:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790100318.152762:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140899968:0@lo:41: 00000020:00000004:3.0:1790100318.198136:0:9002:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100318.198147:0:9002:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1790100319.050027:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100319.178017:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140900096:0@lo:41: 00000100:00100000:3.0:1790100319.178082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100319.178237:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140900096 00000100:00100000:0.0:1790100319.178244:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140900096 00000100:00100000:0.0:1790100319.178291:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790100319.178308:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140900096:12345-0@lo:41: 00000004:00000024:0.0:1790100319.178354:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1790100319.178854:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140900096:12345-0@lo:41: Request processed in 554us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100319.178863:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790100319.178988:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140900096:0@lo:41: 00010000:00010000:2.0:1790100320.072579:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100321.096588:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100322.120467:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100322.761313:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140900224:0@lo:400: 00000100:00100000:0.0:1790100322.761416:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100322.761467:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140900736:0@lo:400: 00000100:00100000:0.0:1790100322.761491:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100322.761507:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140901248:0@lo:400: 00000100:00100000:0.0:1790100322.761539:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100322.761564:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790100322.761695:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140901248 00000100:00100000:1.0:1790100322.761703:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140901248 00000100:00100000:2.0:1790100322.761714:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140900224 00000100:00100000:2.0:1790100322.761721:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140900224 00000100:00100000:1.0:1790100322.761764:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100322.761768:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790100322.761778:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1877056140901248:12345-0@lo:400: 00000100:00100000:2.0:1790100322.761781:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+21:3644:x1877056140900224:12345-0@lo:400: 00000100:00100000:1.0:1790100322.761840:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1877056140901248:12345-0@lo:400: Request processed in 66us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100322.761844:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+21:3644:x1877056140900224:12345-0@lo:400: Request processed in 66us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100322.761850:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100322.761890:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140900480:0@lo:400: 00000100:00100000:1.0:1790100322.761917:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100322.761921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790100322.761964:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140900992:0@lo:400: 00000100:00080000:2.0:1790100322.761985:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100322.761995:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100322.762013:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140900736 00000100:00100000:2.0:1790100322.762018:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140900736 00000100:00100000:1.0:1790100322.762027:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790100322.762036:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140900352:0@lo:400: 00000100:00100000:2.0:1790100322.762049:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140900480 00000100:00100000:2.0:1790100322.762054:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140900480 00000100:00100000:1.0:1790100322.762066:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100322.762084:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140900864:0@lo:400: 00000100:00100000:1.0:1790100322.762104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100322.762121:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140901376:0@lo:13: 00000100:00100000:2.0:1790100322.762149:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100322.762151:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100322.762161:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140900736:12345-0@lo:400: 00000100:00100000:1.0:1790100322.762192:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790100322.762204:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140900480:12345-0@lo:400: 00000100:00100000:2.0:1790100322.762208:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140900736:12345-0@lo:400: Request processed in 47us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100322.762217:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790100322.762238:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140900992 00000100:00100000:2.0:1790100322.762242:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140900992 00000100:00100000:1.0:1790100322.762264:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140900480:12345-0@lo:400: Request processed in 64us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100322.762272:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790100322.762273:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140900352 00000100:00100000:2.0:1790100322.762278:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140900352 00000100:00100000:1.0:1790100322.762298:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140900864 00000100:00100000:2.0:1790100322.762302:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100322.762304:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140900864 00000100:00100000:2.0:1790100322.762319:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140900992:12345-0@lo:400: 00000100:00100000:1.0:1790100322.762329:0:6513:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790100322.762336:0:6513:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790100322.762386:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140900992:12345-0@lo:400: Request processed in 69us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100322.762393:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100322.762404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140900480:0@lo:400: 00000100:00100000:2.0:1790100322.762410:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790100322.762419:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140900352:12345-0@lo:400: 00010000:00080000:1.0:1790100322.762424:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c197f800 x1877056140900992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100322.762437:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140900992:0@lo:400: 00010000:00080000:1.0:1790100322.762465:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c197dc00 x1877056140900352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100322.762470:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140900352:12345-0@lo:400: Request processed in 41us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100322.762484:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140900352:0@lo:400: 00000100:00100000:2.0:1790100322.762486:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790100322.762517:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790100322.762525:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140900864:12345-0@lo:400: 00000100:00100000:1.0:1790100322.762525:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140901376 00000100:00100000:1.0:1790100322.762537:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140901376 00000100:00100000:2.0:1790100322.762566:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140900864:12345-0@lo:400: Request processed in 41us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100322.762573:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790100322.762592:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100322.762596:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100322.762598:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790100322.762673:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100322.762680:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1877056140901376:12345-0@lo:13: 00002000:00000024:2.0:1790100322.762701:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100322.762731:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1877056140901376:12345-0@lo:13: Request processed in 52us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100322.762737:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100322.762787:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140900608:0@lo:400: 00000100:00100000:2.0:1790100322.762820:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100322.762824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100322.762834:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140901504:0@lo:13: 00000100:00100000:0.0:1790100322.762894:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140901120:0@lo:400: 00000100:00100000:1.0:1790100322.762933:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140900608 00000100:00100000:1.0:1790100322.762948:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140900608 00000100:00100000:1.0:1790100322.762978:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790100322.762986:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140900608:12345-0@lo:400: 00000100:00100000:0.0:1790100322.764784:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100322.764836:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140900224:0@lo:400: 00000100:00100000:0.0:1790100322.764882:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140900736:0@lo:400: 00010000:00080000:0.0:1790100322.764897:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6255f80 x1877056140901248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100322.764909:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140901248:0@lo:400: 00000100:00100000:0.0:1790100322.764964:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140901120 00000100:00100000:0.0:1790100322.764969:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140901120 00000100:00100000:0.0:1790100322.765007:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100322.765016:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1877056140901120:12345-0@lo:400: 00000100:00100000:0.0:1790100322.765064:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1877056140901120:12345-0@lo:400: Request processed in 50us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100322.765072:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790100322.765105:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c197d500 x1877056140901120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100322.765116:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140901120:0@lo:400: 00000100:00100000:2.0:1790100322.765306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100322.765455:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140900608:12345-0@lo:400: Request processed in 2469us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100322.765464:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1790100322.765588:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c197ea00 x1877056140900864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100322.765601:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140900864:0@lo:400: 00010000:00080000:1.0:1790100322.765614:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79eca80 x1877056140901376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100322.765631:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140901376:0@lo:13: 00010000:00080000:2.0:1790100322.769663:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c197d880 x1877056140900608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100322.769680:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140900608:0@lo:400: 00000100:00100000:0.0:1790100322.770530:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140901504 00000100:00100000:0.0:1790100322.770539:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140901504 00000100:00100000:0.0:1790100322.770587:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100322.770594:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056140901504:12345-0@lo:13: 00002000:00000024:0.0:1790100322.770616:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100322.770670:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056140901504:12345-0@lo:13: Request processed in 77us (5365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100322.770677:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790100322.770706:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b40000 x1877056140901504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100322.770722:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140901504:0@lo:13: 00010000:00010000:1.0:1790100323.148301:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100323.274037:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100323.274059:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140901632:0@lo:41: 00000100:00100000:0.0:1790100323.274115:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100323.274175:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140901632 00000100:00100000:1.0:1790100323.274184:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140901632 00000100:00100000:1.0:1790100323.274238:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790100323.274248:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140901632:12345-0@lo:41: 00000004:00000024:1.0:1790100323.274280:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1790100323.274356:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140901632:12345-0@lo:41: Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100323.274364:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100323.274502:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140901632:0@lo:41: 00000001:00080000:3.0:1790100323.790372:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1790100323.790389:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790100324.168558:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100324.296924:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100324.296958:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140901760:0@lo:41: 00000100:00100000:1.0:1790100324.297021:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100324.298235:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140901760 00000100:00100000:2.0:1790100324.298243:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140901760 00000100:00100000:2.0:1790100324.298294:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100324.298303:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140901760:12345-0@lo:41: 00000004:00000024:2.0:1790100324.298354:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1790100324.298417:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140901760:12345-0@lo:41: Request processed in 109us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.298424:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100324.298467:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140901760:0@lo:41: 00000020:01000004:3.0:1790100324.537067:0:9502:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790100324.537071:0:9502:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790100324.537073:0:9502:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790100324.537249:0:9502:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9261a6449800 00000020:01000004:3.0:1790100324.537264:0:9502:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790100324.537276:0:9502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790100324.537290:0:9502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9260829619c0) 00000020:00000080:3.0:1790100324.537306:0:9502:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790100324.562325:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1790100324.562494:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1790100324.577244:0:9502:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790100324.577561:0:9502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790100324.577574:0:9502:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790100324.577585:0:9502:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc87a4f22982869dc 00000020:01000004:1.0:1790100324.577591:0:9502:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1790100324.577612:0:9502:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790100324.577615:0:9502:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790100324.577621:0:9502:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790100324.577648:0:9502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1790100324.577652:0:9502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790100324.595263:0:9502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790100324.595300:0:9502:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1790100324.595305:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790100324.595306:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790100324.595307:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100324.595309:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100324.595310:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100324.595311:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100324.595313:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100324.595314:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790100324.595315:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790100324.595316:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100324.595318:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790100324.595321:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1790100324.595323:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790100324.595325:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790100324.595326:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100324.595327:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100324.595328:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100324.595329:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100324.595330:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100324.595331:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790100324.595332:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790100324.595333:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100324.595334:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790100324.595586:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790100324.595605:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140901888:0@lo:253: 00000100:00100000:0.0:1790100324.595744:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.595802:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140901888 00000100:00100000:0.0:1790100324.595803:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff92618556fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100324.595812:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140901888 00000100:00100000:1.0:1790100324.595869:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790100324.595877:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:9502:x1877056140901888:12345-0@lo:253: 20000000:01000000:1.0:1790100324.595912:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790100324.595916:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1790100324.595921:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1790100324.595931:0:6505:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790100324.596126:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100324.596361:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1790100324.596376:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790100324.596394:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1790100324.596400:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790100324.596413:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1790100324.596428:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1790100324.597714:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1790100324.597740:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1790100324.597743:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1790100324.597769:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1790100324.597786:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790100324.597805:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1790100324.597811:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1790100324.597825:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1790100324.597832:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790100324.597844:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1790100324.597916:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1790100324.598033:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1790100324.598045:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1790100324.598047:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1790100324.598062:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1790100324.598067:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790100324.598192:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1790100324.598201:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1790100324.598220:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1790100324.598228:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790100324.598244:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1790100324.598261:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1790100324.598830:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1790100324.598845:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1790100324.598846:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1790100324.598981:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1790100324.598989:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790100324.599009:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1790100324.599016:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1790100324.599029:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1790100324.599034:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790100324.599046:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1790100324.599060:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1790100324.599073:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790100324.599193:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790100324.599197:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790100324.599242:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790100324.599245:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790100324.600011:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1790100324.600044:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1790100324.600057:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790100324.600511:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790100324.600540:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1790100324.600555:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1790100324.600564:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790100324.600566:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790100324.600960:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1790100324.600978:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1790100324.600992:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1790100324.601262:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1790100324.601282:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1790100324.601297:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1790100324.601318:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1790100324.601319:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790100324.601833:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1790100324.601851:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1790100324.601939:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1790100324.602072:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1790100324.602132:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1790100324.602150:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1790100324.602171:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790100324.602173:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790100324.602324:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1790100324.602607:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1790100324.602626:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1790100324.602640:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1790100324.602650:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790100324.602651:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790100324.603206:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1790100324.603224:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1790100324.603239:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1790100324.603552:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1790100324.603579:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1790100324.603600:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:0.0:1790100324.603616:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790100324.603635:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603652:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603660:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982868fc expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603668:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828693b expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603687:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286957 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603694:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286981 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603701:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828699d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603709:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603717:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603755:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.603767:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 21 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.603780:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902016:0@lo:104: 00000100:00100000:0.0:1790100324.604117:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100324.604517:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828699d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.604527:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828699d expref: 21 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.604536:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902144:0@lo:104: 00000100:00100000:0.0:1790100324.604567:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.604697:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140902016 00000100:00100000:1.0:1790100324.604705:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140902016 00000100:00100000:1.0:1790100324.604750:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140902144 00000100:00100000:1.0:1790100324.604754:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140902144 00000100:00100000:1.0:1790100324.604768:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100324.604776:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140902016:12345-0@lo:104: 00010000:00010000:1.0:1790100324.604799:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.604861:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100324.604867:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140902016:12345-0@lo:104: Request processed in 92us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.604874:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100324.604898:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790100324.604911:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140902144:12345-0@lo:104: 00010000:00010000:2.0:1790100324.604921:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.604975:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790100324.604981:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:6505:x1877056140902144:12345-0@lo:104: Request processed in 74us (413us total) trans 0 rc 0/0 00010000:00010000:0.0:1790100324.605246:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286981 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.605257:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286981 expref: 21 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.605266:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902272:0@lo:104: 00000100:00100000:0.0:1790100324.605534:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.605554:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140902272 00000100:00100000:0.0:1790100324.605557:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140902272 00010000:00010000:1.0:1790100324.605615:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100324.605621:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605642:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100324.605646:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605655:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100324.605662:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100324.605667:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100324.605701:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605707:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100324.605723:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605729:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f22982869c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605740:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100324.605744:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605749:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d600 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100324.605751:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605768:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100324.605775:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100324.605781:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100324.605805:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605812:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100324.605817:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605974:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f229828699d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.605985:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100324.605987:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100324.605989:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100324.605997:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100324.606014:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140902400:0@lo:103: 00000100:00100000:1.0:1790100324.606043:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.606067:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100324.606072:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140902528:0@lo:103: 00000100:00100000:1.0:1790100324.606092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.606119:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140902400 00000100:00100000:1.0:1790100324.606123:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140902400 00010000:00010000:1.0:1790100324.606141:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 22 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.606167:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140902528 00000100:00100000:1.0:1790100324.606170:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140902528 00010000:00010000:1.0:1790100324.606182:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828699d expref: 23 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.606194:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100324.606201:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+23:3641:x1877056140902400:12345-0@lo:103: 00010000:00010000:1.0:1790100324.606212:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100324.606216:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 23 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.606226:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 23 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.606240:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100324.606267:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+23:3641:x1877056140902400:12345-0@lo:103: Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.606273:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100324.606286:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100324.606292:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+22:3641:x1877056140902528:12345-0@lo:103: 00010000:00010000:1.0:1790100324.606299:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100324.606303:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828699d expref: 22 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.606310:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828699d expref: 22 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.606319:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100324.606363:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+22:3641:x1877056140902528:12345-0@lo:103: Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.606370:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100324.606406:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140902528:0@lo:103: 00000100:00100000:1.0:1790100324.606415:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140902400:0@lo:103: 00000100:00100000:2.0:1790100324.608597:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790100324.609106:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100324.609119:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140902272:12345-0@lo:104: 00010000:00010000:0.0:1790100324.609135:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.609204:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100324.609210:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:6505:x1877056140902272:12345-0@lo:104: Request processed in 95us (3677us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100324.609216:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1790100324.609301:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286957 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.609313:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286957 expref: 21 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.609323:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902656:0@lo:104: 00000100:00100000:0.0:1790100324.609402:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100324.609520:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828693b expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.609539:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828693b expref: 21 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.609548:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902784:0@lo:104: 00000100:00100000:0.0:1790100324.609571:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100324.609635:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982868fc expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.609644:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982868fc expref: 21 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.609652:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902912:0@lo:104: 00000100:00100000:0.0:1790100324.609678:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.609695:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140902656 00000100:00100000:1.0:1790100324.609701:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140902656 00000100:00100000:1.0:1790100324.609735:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790100324.609745:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140902784 00000100:00100000:1.0:1790100324.609748:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140902784 00010000:00010000:0.0:1790100324.609755:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.609759:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140902912 00000100:00100000:1.0:1790100324.609761:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140902912 00010000:00010000:0.0:1790100324.609765:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 21 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.609771:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100324.609773:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140903040:0@lo:104: 00000100:00100000:1.0:1790100324.609777:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+6:6505:x1877056140902656:12345-0@lo:104: 00010000:00010000:1.0:1790100324.609785:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.609803:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.609817:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6a80 going to sleep for 11 seconds 00010000:00010000:0.0:1790100324.609837:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180030a00/0xc87a4f22982869ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982869c7 expref: 21 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.609849:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902016:0@lo:104: 00010000:00010000:1.0:1790100324.609948:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790100324.609953:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+6:6505:x1877056140902656:12345-0@lo:104: Request processed in 177us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.609960:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790100324.609972:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140903040 00010000:00010000:0.0:1790100324.609973:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189916c00/0xc87a4f22982869a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828699d expref: 20 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.609975:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140903040 00000100:00100000:1.0:1790100324.609988:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790100324.609993:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+6:6505:x1877056140902784:12345-0@lo:104: 00000100:00100000:0.0:1790100324.609994:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902144:0@lo:104: 00010000:00010000:1.0:1790100324.610000:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.610006:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902272:0@lo:104: 00000100:00100000:0.0:1790100324.610012:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902656:0@lo:104: 00000100:00100000:0.0:1790100324.610029:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790100324.610035:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bcc1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+6:6505:x1877056140902912:12345-0@lo:104: 00010000:00010000:1.0:1790100324.610042:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1790100324.610043:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.610047:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+6:6505:x1877056140902784:12345-0@lo:104: Request processed in 55us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.610053:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790100324.610064:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1790100324.610068:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790100324.610070:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+5:6505:x1877056140903040:12345-0@lo:104: 00000100:00100000:0.0:1790100324.610072:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bcc1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+5:6505:x1877056140902912:12345-0@lo:104: Request processed in 38us (394us total) trans 0 rc 0/0 00010000:00010000:1.0:1790100324.610077:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.610077:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1790100324.610101:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1790100324.610106:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+5:6505:x1877056140903040:12345-0@lo:104: Request processed in 37us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.610111:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790100324.610126:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790100324.610132:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610139:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189917000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100324.610144:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610152:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100324.610159:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100324.610164:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100324.610199:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610206:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790100324.610216:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902784:0@lo:104: 00000100:00100000:0.0:1790100324.610222:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140902912:0@lo:104: 00010000:00010000:1.0:1790100324.610225:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610232:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286988 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.610232:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877056140903040:0@lo:104: 00010000:00010000:1.0:1790100324.610242:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790100324.610245:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610251:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100324.610253:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610260:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100324.610266:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.610269:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100324.610272:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100324.610284:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610289:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100324.610294:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610310:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f229828695e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610320:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790100324.610323:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610328:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565de00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100324.610331:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.610569:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100324.610574:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.610581:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100324.610584:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.610602:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610610:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100324.610617:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100324.610623:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100324.610638:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610644:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100324.610657:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610664:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f229828693b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286942 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610675:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1790100324.610676:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100324.610683:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100324.610684:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610689:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58800 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100324.610692:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.610697:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610698:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.610703:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1790100324.610705:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.610708:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100324.610710:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790100324.610715:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926180030000/0xc87a4f22982868fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286903 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610720:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.610724:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100324.610726:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100324.610726:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100324.610727:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100324.610729:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610735:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f22982868d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868d9 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.610747:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100324.610749:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100324.610751:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100324.610763:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140903168:0@lo:103: 00000100:00100000:1.0:1790100324.610916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.610954:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140903680:0@lo:103: 00000100:00100000:1.0:1790100324.610987:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.611007:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100324.611012:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140903296:0@lo:103: 00000100:00100000:1.0:1790100324.611032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.611059:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140903168 00000100:00100000:1.0:1790100324.611062:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140903168 00010000:00010000:1.0:1790100324.611080:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286981 expref: 20 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.611095:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140903680 00000100:00100000:1.0:1790100324.611097:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140903680 00010000:00010000:1.0:1790100324.611107:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 21 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.611116:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140903296 00000100:00100000:1.0:1790100324.611118:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140903296 00010000:00010000:1.0:1790100324.611140:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286957 expref: 22 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.611155:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100324.611161:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+22:3643:x1877056140903168:12345-0@lo:103: 00010000:00010000:1.0:1790100324.611179:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100324.611185:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286981 expref: 22 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611195:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286981 expref: 22 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611207:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189917600/0xc87a4f2298286988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286981 expref: 22 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611222:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100324.611251:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+21:3643:x1877056140903168:12345-0@lo:103: Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.611258:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100324.611273:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790100324.611279:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184256c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+20:3643:x1877056140903680:12345-0@lo:103: 00000100:00100000:0.0:1790100324.611279:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140903168:0@lo:103: 00010000:00010000:1.0:1790100324.611286:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100324.611291:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 20 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611299:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 20 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611308:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565d400/0xc87a4f22982868d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982868d2 expref: 20 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611316:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100324.611356:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184256c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+19:3643:x1877056140903680:12345-0@lo:103: Request processed in 78us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.611363:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100324.611363:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140903680:0@lo:103: 00000100:00100000:1.0:1790100324.611395:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790100324.611402:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+18:3643:x1877056140903296:12345-0@lo:103: 00010000:00010000:1.0:1790100324.611409:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100324.611413:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286957 expref: 18 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611422:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286957 expref: 18 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611499:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59800/0xc87a4f229828695e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286957 expref: 18 pid: 6506 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611509:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100324.611546:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+17:3643:x1877056140903296:12345-0@lo:103: Request processed in 145us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.611554:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790100324.611577:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140903552:0@lo:103: 00000100:00100000:0.0:1790100324.611583:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140903296:0@lo:103: 00000100:00100000:1.0:1790100324.611603:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.611633:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100324.611641:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140903424:0@lo:103: 00000100:00100000:1.0:1790100324.611661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.611690:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140903552 00000100:00100000:0.0:1790100324.611694:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140903552 00010000:00010000:1.0:1790100324.611701:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100324.611709:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140903424 00010000:00010000:0.0:1790100324.611710:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982868fc expref: 17 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.611711:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140903424 00010000:00010000:1.0:1790100324.611723:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828693b expref: 18 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.611738:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790100324.611745:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+18:3642:x1877056140903552:12345-0@lo:103: 00010000:00010000:1.0:1790100324.611753:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100324.611757:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982868fc expref: 18 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611765:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982868fc expref: 18 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.611775:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189917800/0xc87a4f2298286903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982868fc expref: 18 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.611797:0:6499:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790100324.611804:0:6499:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790100324.611899:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1790100324.611909:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100324.611913:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100324.611934:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+17:3642:x1877056140903424:12345-0@lo:103: 00010000:00010000:2.0:1790100324.611945:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790100324.611956:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+17:3642:x1877056140903552:12345-0@lo:103: Request processed in 209us (349us total) trans 0 rc 0/0 00010000:00010000:2.0:1790100324.611961:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828693b expref: 17 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.611966:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1790100324.611980:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828693b expref: 17 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.611992:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58200/0xc87a4f2298286942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828693b expref: 16 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.612002:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140903552:0@lo:103: 00010000:00010000:2.0:1790100324.612004:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612014:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612026:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612034:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612042:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612049:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612056:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100324.612060:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612068:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612089:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.612097:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100324.612205:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.612215:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.612222:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59e00/0xc87a4f22982869e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790100324.612237:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790100324.612261:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+15:3642:x1877056140903424:12345-0@lo:103: Request processed in 338us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.612269:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100324.612302:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140903424:0@lo:103: 00000100:00100000:1.0:1790100324.615826:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:9502:x1877056140901888:12345-0@lo:253: Request processed in 19942us (20074us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.615840:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790100324.615988:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140901888:0@lo:253: 10000000:01000000:0.0:1790100324.616003:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790100324.616007:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790100324.616008:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790100324.616010:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100324.616011:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1790100324.616012:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100324.616014:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100324.616015:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100324.616016:0:9502:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790100324.616018:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100324.616019:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790100324.616038:0:9502:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9261a6449800 from lustre-OST0001 10000000:01000000:0.0:1790100324.616066:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790100324.616069:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790100324.616077:0:9502:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9261b2304d40 local copy 10000000:01000000:0.0:1790100324.616096:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790100324.616129:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.616155:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.616165:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.616183:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140903808:0@lo:101: 00000100:00100000:0.0:1790100324.616217:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.616253:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.616273:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140903808 00000100:00100000:2.0:1790100324.616281:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140903808 00000100:00100000:2.0:1790100324.616328:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790100324.616356:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:9502:x1877056140903808:12345-0@lo:101: 00010000:00010000:2.0:1790100324.616369:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100324.616383:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926180031800/0xc87a4f22982869f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982869ea expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.616405:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926180031800/0xc87a4f22982869f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982869ea expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.616416:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926180031800/0xc87a4f22982869f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982869ea expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.616423:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031800, rc 0) 00000100:00100000:1.0:1790100324.616482:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140903808:0@lo:101: 00010000:00010000:1.0:1790100324.616495:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.616503:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100324.616537:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140903808:12345-0@lo:101: Request processed in 200us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.616544:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790100324.616597:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140903936:0@lo:501: 00000100:00100000:1.0:1790100324.616628:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.616659:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082abe240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100324.616674:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140903936 00000100:00100000:0.0:1790100324.616680:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140903936 00000100:00100000:0.0:1790100324.616710:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790100324.616717:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140903936:12345-0@lo:501: 00000100:00100000:0.0:1790100324.616778:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140903936:12345-0@lo:501: Request processed in 61us (150us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100324.616785:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790100324.616874:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140903936:0@lo:501: 10000000:01000000:1.0:1790100324.616890:0:9502:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790100324.616907:0:9502:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790100324.616912:0:9502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.616920:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.616943:0:9502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.616964:0:9502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790100324.616985:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9261a6449800 10000000:01000000:1.0:1790100324.616990:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790100324.616994:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790100324.616996:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100324.617000:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790100324.617002:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790100324.617018:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.617026:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.617033:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100324.617046:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904064:0@lo:101: 00000100:00100000:1.0:1790100324.617074:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.617253:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082abe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100324.617270:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140904064 00000100:00100000:1.0:1790100324.617274:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140904064 00000100:00100000:1.0:1790100324.617299:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790100324.617307:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904064:12345-0@lo:101: 00010000:00010000:1.0:1790100324.617314:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100324.617323:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982869f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.617365:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.617374:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.617390:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189916600, rc 0) 00000100:00100000:1.0:1790100324.617422:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140904064:12345-0@lo:101: Request processed in 116us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.617428:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:0.0:1790100324.617557:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100324.617565:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.617573:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59000 already unused, calling callback (ffffffffc13ccc20) 00000100:00100000:1.0:1790100324.617574:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904064:0@lo:101: 10000000:00010000:0.0:1790100324.617579:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.617588:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.617597:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.617598:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100324.617614:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100324.617628:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790100324.617648:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.617654:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790100324.617665:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904320:0@lo:501: 00010000:00010000:0.0:1790100324.617672:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.617680:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f22982869ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc87a4f22982869f1 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.617692:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100324.617694:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100324.617697:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100324.617701:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.617707:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100324.617719:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140904192:0@lo:103: 00000100:00100000:1.0:1790100324.617729:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082abe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100324.617751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.617794:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140904320 00000100:00100000:0.0:1790100324.617798:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140904320 00000100:00100000:1.0:1790100324.617842:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140904192 00000100:00100000:1.0:1790100324.617847:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140904192 00000100:00100000:1.0:1790100324.617939:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100324.617948:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+17:3643:x1877056140904192:12345-0@lo:103: 00010000:00010000:1.0:1790100324.617957:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100324.617969:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180031800/0xc87a4f22982869f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f22982869ea expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.617989:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100324.618019:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+16:3643:x1877056140904192:12345-0@lo:103: Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.618026:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100324.618254:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790100324.618263:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904320:12345-0@lo:501: 00000100:00100000:0.0:1790100324.618364:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904320:12345-0@lo:501: Request processed in 103us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100324.618371:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790100324.622082:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140904192:0@lo:103: 00000100:00100000:1.0:1790100324.622131:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904320:0@lo:501: 00000100:00100000:1.0:1790100324.622178:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904448:0@lo:503: 00000100:00100000:1.0:1790100324.622250:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.622289:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082abe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100324.622309:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140904448 00000100:00100000:1.0:1790100324.622315:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140904448 00000100:00100000:1.0:1790100324.623298:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790100324.623313:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904448:12345-0@lo:503: 00000100:00100000:1.0:1790100324.623738:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904448:12345-0@lo:503: Request processed in 428us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.623747:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790100324.625405:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904448:0@lo:503: 00000040:00080000:0.0:1790100324.625697:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100324.625767:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904576:0@lo:502: 00000100:00100000:0.0:1790100324.626722:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.626766:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.626844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140904576 00000100:00100000:2.0:1790100324.626858:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140904576 00000100:00100000:2.0:1790100324.626907:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790100324.626917:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904576:12345-0@lo:502: 00000100:00100000:2.0:1790100324.627043:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904576:12345-0@lo:502: Request processed in 127us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.627051:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790100324.627073:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904576:0@lo:502: 00000040:00080000:0.0:1790100324.627263:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790100324.627304:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790100324.627318:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790100324.627330:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790100324.627366:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790100324.627382:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790100324.627406:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904704:0@lo:502: 00000100:00100000:0.0:1790100324.627549:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.627566:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.627662:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140904704 00000100:00100000:2.0:1790100324.627667:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140904704 00000100:00100000:2.0:1790100324.627696:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790100324.627703:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904704:12345-0@lo:502: 00000100:00100000:2.0:1790100324.627768:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904704:12345-0@lo:502: Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.627775:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790100324.628048:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904704:0@lo:502: 00000040:00080000:0.0:1790100324.628088:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1790100324.628096:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1790100324.628898:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790100324.628906:0:9514:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1790100324.628912:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100324.628915:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790100324.628921:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790100324.628953:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92608323cd40) 00000020:00000080:2.0:1790100324.628973:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790100324.628980:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790100324.629053:0:9514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261a6449800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790100324.629062:0:9514:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790100324.629069:0:9514:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc87a4f2298286a0d 00010000:00010000:0.0:1790100324.635252:0:9514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1790100324.635607:0:9514:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1790100324.639488:0:9514:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790100324.640295:0:9514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1790100324.645316:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1790100324.645548:0:9514:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1790100324.651038:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1790100324.652408:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790100324.652418:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100324.652424:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100324.652426:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790100324.652430:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100324.652434:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100324.652436:0:9514:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790100324.652446:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790100324.652447:0:9514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790100324.652465:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100324.652469:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100324.652470:0:9514:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790100324.652473:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790100324.652606:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1790100324.652690:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790100324.652710:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.652723:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100324.652731:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261a6449800 from 1 10000000:01000000:0.0:1790100324.652739:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100324.652773:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.652782:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.652792:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.653031:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904832:0@lo:101: 00000100:00100000:0.0:1790100324.653093:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.653182:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6300 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.653274:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140904832 00000100:00100000:2.0:1790100324.653282:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140904832 00000100:00100000:2.0:1790100324.653373:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790100324.653383:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:9502:x1877056140904832:12345-0@lo:101: 00010000:00010000:2.0:1790100324.653395:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100324.653412:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286a14 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.653433:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.653444:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.653453:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031800, rc 0) 00000100:00100000:2.0:1790100324.653501:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140904832:12345-0@lo:101: Request processed in 119us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.653507:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790100324.656462:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904832:0@lo:101: 00010000:00010000:3.0:1790100324.656487:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100324.656499:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100324.656651:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904960:0@lo:501: 00000100:00100000:3.0:1790100324.656706:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100324.656746:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff926183ebb840 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.656763:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140904960 00000100:00100000:2.0:1790100324.656769:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140904960 00000100:00100000:2.0:1790100324.656932:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790100324.656944:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140904960:12345-0@lo:501: 00000100:00100000:2.0:1790100324.657057:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140904960:12345-0@lo:501: Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100324.657105:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140904960:0@lo:501: 00000100:00100000:3.0:1790100324.657141:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905088:0@lo:503: 00000100:00100000:3.0:1790100324.657250:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100324.657265:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff926183ebb840 going to sleep for 11 seconds 00000100:00100000:3.0:1790100324.660569:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140905088 00000100:00100000:3.0:1790100324.660584:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140905088 00000100:00100000:2.0:1790100324.661396:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790100324.661787:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790100324.661800:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140905088:12345-0@lo:503: 00000100:00100000:3.0:1790100324.662064:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140905088:12345-0@lo:503: Request processed in 267us (4813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100324.662072:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790100324.662222:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905088:0@lo:503: 00000040:00080000:0.0:1790100324.662613:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100324.662757:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905216:0@lo:502: 00000100:00100000:0.0:1790100324.662798:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.662978:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.663014:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140905216 00000100:00100000:2.0:1790100324.663021:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140905216 00000100:00100000:2.0:1790100324.663088:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790100324.663098:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140905216:12345-0@lo:502: 00000100:00100000:2.0:1790100324.663199:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140905216:12345-0@lo:502: Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.663206:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790100324.663270:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905216:0@lo:502: 00000040:00080000:0.0:1790100324.663485:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790100324.663511:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790100324.663532:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905344:0@lo:502: 00000100:00100000:0.0:1790100324.663564:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.663854:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100324.663983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140905344 00000100:00100000:3.0:1790100324.663989:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140905344 00000100:00100000:3.0:1790100324.664013:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790100324.664020:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140905344:12345-0@lo:502: 00000100:00100000:3.0:1790100324.664136:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140905344:12345-0@lo:502: Request processed in 115us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100324.664211:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790100324.664304:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905344:0@lo:502: 00000040:00080000:0.0:1790100324.664524:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790100324.664534:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790100324.665118:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100324.665128:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100324.665130:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790100324.665137:0:9518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261a6449800 00000020:00000080:3.0:1790100324.665139:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100324.665218:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100324.665223:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100324.665224:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790100324.665227:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790100324.665428:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790100324.665526:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100324.665588:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.665599:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100324.665654:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790100324.665657:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9261a6449800 10000000:01000000:0.0:1790100324.665659:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9261a6449800 10000000:01000000:0.0:1790100324.665663:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790100324.665669:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261a6449800 from 1 10000000:01000000:0.0:1790100324.665672:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790100324.665700:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.665708:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.665717:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.665733:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905472:0@lo:101: 00000100:00100000:0.0:1790100324.665780:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.665828:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140905472 00000100:00100000:1.0:1790100324.665834:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140905472 00000100:00100000:1.0:1790100324.665937:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790100324.665946:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:9502:x1877056140905472:12345-0@lo:101: 00010000:00010000:1.0:1790100324.665957:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100324.665968:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286a22 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.665988:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100324.665998:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.666028:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6000 going to sleep for 11 seconds 00010000:00010000:1.0:1790100324.666117:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189917800, rc 0) 00000100:00100000:1.0:1790100324.666201:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905472:12345-0@lo:101: Request processed in 255us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.666208:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790100324.666241:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905472:0@lo:101: 00010000:00010000:0.0:1790100324.666254:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.666263:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.666402:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905600:0@lo:501: 00000100:00100000:0.0:1790100324.666430:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.666567:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100324.666597:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140905600 00000100:00100000:3.0:1790100324.666602:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140905600 00000100:00100000:3.0:1790100324.666725:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790100324.666733:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905600:12345-0@lo:501: 00000100:00100000:3.0:1790100324.666843:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905600:12345-0@lo:501: Request processed in 111us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100324.666850:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790100324.667022:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905600:0@lo:501: 00000100:00100000:0.0:1790100324.667050:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905728:0@lo:503: 00000100:00100000:0.0:1790100324.667089:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.667194:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.667273:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140905728 00000100:00100000:2.0:1790100324.667278:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140905728 00000100:00100000:2.0:1790100324.667317:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790100324.667325:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905728:12345-0@lo:503: 00000100:00100000:2.0:1790100324.667539:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905728:12345-0@lo:503: Request processed in 214us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.667546:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790100324.667750:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905728:0@lo:503: 00000040:00080000:0.0:1790100324.668080:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100324.668139:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905856:0@lo:502: 00000100:00100000:0.0:1790100324.668241:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.668272:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100324.671735:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140905856 00000100:00100000:1.0:1790100324.671751:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140905856 00000100:00100000:1.0:1790100324.671851:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790100324.672059:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905856:12345-0@lo:502: 00000100:00100000:1.0:1790100324.672291:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905856:12345-0@lo:502: Request processed in 431us (4049us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.672308:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790100324.672691:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905856:0@lo:502: 00000040:00080000:0.0:1790100324.672940:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790100324.672974:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790100324.672987:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790100324.672999:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790100324.673011:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790100324.673023:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790100324.673036:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790100324.673049:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790100324.673062:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790100324.673073:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790100324.673083:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790100324.673093:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790100324.673104:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790100324.673127:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790100324.673596:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790100324.673693:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790100324.673711:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790100324.673723:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790100324.673734:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790100324.673746:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790100324.673758:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790100324.673770:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790100324.673781:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790100324.673793:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790100324.673805:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790100324.673972:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790100324.673987:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790100324.673998:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1790100324.674010:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790100324.674023:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1790100324.674035:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1790100324.674047:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1790100324.674059:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1790100324.674070:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1790100324.674083:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1790100324.674096:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1790100324.674107:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1790100324.674119:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1790100324.674131:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1790100324.674213:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1790100324.674233:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1790100324.674266:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1790100324.674281:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1790100324.674295:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1790100324.674309:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1790100324.674322:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1790100324.675105:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905984:0@lo:502: 00000100:00100000:0.0:1790100324.675725:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.679087:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100324.681586:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140905984 00000100:00100000:3.0:1790100324.681599:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140905984 00000100:00100000:3.0:1790100324.681693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790100324.681702:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905984:12345-0@lo:502: 00000100:00100000:3.0:1790100324.682443:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140905984:12345-0@lo:502: Request processed in 740us (6716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100324.682453:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790100324.682592:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140905984:0@lo:502: 00000040:00080000:3.0:1790100324.682687:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1790100324.682701:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1790100324.683411:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790100324.683433:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff926082964d40) 00000020:00000080:3.0:1790100324.683456:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1790100324.683696:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261a6449800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790100324.683700:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261a6449800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790100324.683703:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261a6449800 3 00010000:00080000:3.0:1790100324.683731:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff926083162800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790100324.686780:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1790100324.687335:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790100324.687597:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790100324.687609:0:9519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc87a4f2298286a37 00000100:00080000:2.0:1790100324.687619:0:9519:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790100324.687629:0:9519:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff926083162800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100324.687663:0:9519:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261c1b42680 x1877056140906112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100324.687693:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790100324.688949:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056140906112:0@lo:38: 00000100:00100000:0.0:1790100324.689016:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.689170:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140906112 00000100:00100000:0.0:1790100324.689177:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140906112 00000100:00100000:0.0:1790100324.689206:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100324.689213:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1877056140906112:12345-0@lo:38: 00010000:00080000:0.0:1790100324.689235:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1790100324.689264:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc87a4f2298286a3e 00000004:00100000:0.0:1790100324.689276:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790100324.689304:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9261a631f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100324.689366:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877056140906112:12345-0@lo:38: Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100324.689374:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790100324.689409:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b42680 x1877056140906112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100324.689420:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100324.689428:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1790100324.689434:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790100324.689438:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790100324.689441:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083162800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790100324.689447:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056140906112:0@lo:38: 00000100:00100000:2.0:1790100324.689706:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140906368:0@lo:400: 00000100:00100000:2.0:1790100324.689738:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100324.689759:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140906880:0@lo:400: 00000100:00100000:2.0:1790100324.689782:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100324.689802:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790100324.689808:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140906240:0@lo:400: 00000100:00100000:2.0:1790100324.690224:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100324.690244:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140906752:0@lo:400: 00000100:00100000:2.0:1790100324.690265:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100324.690292:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140906368 00000100:00100000:2.0:1790100324.690296:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140906368 00000100:00100000:2.0:1790100324.690327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100324.690335:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140906368:12345-0@lo:400: 00000100:00100000:2.0:1790100324.690402:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140906368:12345-0@lo:400: Request processed in 67us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.690409:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100324.690427:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140906880 00000100:00100000:2.0:1790100324.690430:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140906880 00000100:00100000:2.0:1790100324.690461:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100324.690469:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140906880:12345-0@lo:400: 00000100:00100000:2.0:1790100324.690497:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140906880:12345-0@lo:400: Request processed in 29us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.690502:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100324.690519:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140906240 00000100:00100000:2.0:1790100324.690522:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140906240 00000100:00100000:2.0:1790100324.690541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140906752 00000100:00100000:2.0:1790100324.690544:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140906752 00000100:00100000:2.0:1790100324.690560:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100324.690566:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140906240:12345-0@lo:400: 00000100:00100000:2.0:1790100324.690595:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140906240:12345-0@lo:400: Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.690601:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100324.690612:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100324.690618:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140906752:12345-0@lo:400: 00000100:00100000:2.0:1790100324.690643:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140906752:12345-0@lo:400: Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.690649:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1790100324.690680:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083284700 x1877056140906240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100324.690691:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140906240:0@lo:400: 00010000:00080000:2.0:1790100324.690710:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083285180 x1877056140906752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100324.690718:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140906752:0@lo:400: 00000100:00100000:2.0:1790100324.690727:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140906368:0@lo:400: 00010000:00080000:2.0:1790100324.690735:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083286680 x1877056140906880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100324.690742:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790100324.690752:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140906880:0@lo:400: 00000100:00080000:2.0:1790100324.690772:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100324.690777:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100324.691691:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140906496:0@lo:400: 00000100:00100000:1.0:1790100324.691732:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.691757:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140907008:0@lo:400: 00000100:00100000:1.0:1790100324.691778:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100324.691798:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100324.691804:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140906624:0@lo:400: 00000100:00100000:0.0:1790100324.692131:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140907008 00000100:00100000:0.0:1790100324.692138:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140907008 00000100:00100000:0.0:1790100324.692265:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100324.692272:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140907008:12345-0@lo:400: 00000100:00100000:0.0:1790100324.692315:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140907008:12345-0@lo:400: Request processed in 44us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100324.692320:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790100324.692432:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100324.692649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790100324.692688:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083285500 x1877056140907008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100324.692698:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1790100324.692710:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140907008:0@lo:400: 00000100:00100000:1.0:1790100324.692728:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140906496 00000100:00100000:1.0:1790100324.692732:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140906496 00000100:00100000:1.0:1790100324.692757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140906624 00000100:00100000:1.0:1790100324.692760:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140906624 00000100:00100000:1.0:1790100324.692778:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790100324.692784:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140906496:12345-0@lo:400: 00000100:00100000:1.0:1790100324.692830:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140906496:12345-0@lo:400: Request processed in 46us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.692836:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790100324.692849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790100324.692855:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140906624:12345-0@lo:400: 00000100:00100000:1.0:1790100324.692901:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140906624:12345-0@lo:400: Request processed in 47us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100324.692917:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1790100324.692954:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790100324.692973:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083284000 x1877056140906624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100324.692983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140906624:0@lo:400: 00010000:00080000:1.0:1790100324.692992:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083285880 x1877056140906496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100324.693000:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140906496:0@lo:400: 00000020:01000004:2.0:1790100324.693102:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790100324.693115:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff92608323b380) 00000020:00000080:2.0:1790100324.693134:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1790100324.693218:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261a6449800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790100324.693222:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261a6449800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790100324.693225:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261a6449800 3 00010000:00080000:2.0:1790100324.693250:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261bcab8000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790100324.699022:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1790100324.699377:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1790100324.699422:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790100324.699443:0:9519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc87a4f2298286a4c 00000100:00080000:2.0:1790100324.699452:0:9519:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790100324.699463:0:9519:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9261bcab8000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100324.699496:0:9519:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261c1b41f80 x1877056140907136/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100324.699530:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1877056140907136:0@lo:38: 00000100:00100000:2.0:1790100324.699597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100324.699653:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140907136 00000100:00100000:2.0:1790100324.699660:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140907136 00000100:00100000:2.0:1790100324.699690:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790100324.699697:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1877056140907136:12345-0@lo:38: 00010000:00080000:2.0:1790100324.699719:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:2.0:1790100324.699758:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc87a4f2298286a53 00000004:00100000:2.0:1790100324.699773:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790100324.699800:0:6513:0:(import.c:65:import_set_state_nolock()) ffff926083b41800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100324.699859:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877056140907136:12345-0@lo:38: Request processed in 161us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.700210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790100324.700255:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261c1b41f80 x1877056140907136/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100324.700264:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790100324.700271:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790100324.700278:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790100324.700281:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790100324.700284:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261bcab8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790100324.700290:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1877056140907136:0@lo:38: 00000100:00080000:2.0:1790100324.700307:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790100324.700609:0:9520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9520:1877056140907264:0@lo:901: 00000100:00100000:0.0:1790100324.700644:0:9520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.700669:0:9520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.701331:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140907264 00000100:00100000:2.0:1790100324.701357:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140907264 00000100:00100000:2.0:1790100324.701403:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100324.701411:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9520:x1877056140907264:12345-0@lo:901: 00000100:00100000:2.0:1790100324.701504:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9520:x1877056140907264:12345-0@lo:901: Request processed in 94us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.701518:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790100324.701541:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790100324.701569:0:9520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083287800 x1877056140907264/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790100340 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100324.701581:0:9520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9520:1877056140907264:0@lo:901: 00000040:00080000:2.0:1790100324.702406:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1790100324.702530:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1790100324.702557:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790100324.702578:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100324.702588:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790100324.702632:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790100324.702634:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790100324.702636:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100324.702637:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100324.702638:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100324.702640:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100324.702641:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100324.702642:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790100324.702644:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790100324.702646:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100324.702647:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790100324.702651:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1790100324.702653:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790100324.702655:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790100324.702656:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100324.702657:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100324.702658:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100324.702659:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100324.702661:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100324.702662:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790100324.702663:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790100324.702668:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100324.702669:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790100324.702688:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790100324.702700:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140907392:0@lo:253: 00000100:00100000:3.0:1790100324.702744:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100324.702775:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261941186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100324.702792:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140907392 00000100:00100000:3.0:1790100324.702797:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140907392 00000100:00100000:3.0:1790100324.702840:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790100324.702848:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140907392:12345-0@lo:253: 20000000:01000000:3.0:1790100324.703062:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790100324.703077:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790100324.711099:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790100324.711118:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790100324.711216:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790100324.711221:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790100324.711241:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711259:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286949 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711268:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828698f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711276:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711313:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828698f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711327:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828698f expref: 17 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100324.711370:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b41f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140907520:0@lo:104: 00000100:00100000:2.0:1790100324.711425:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100324.711463:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286949 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711482:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286949 expref: 17 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100324.711491:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b43480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140907648:0@lo:104: 00000100:00100000:2.0:1790100324.711514:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100324.711531:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100324.711550:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140907520 00000100:00100000:2.0:1790100324.711556:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140907520 00000100:00100000:2.0:1790100324.711595:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140907648 00000100:00100000:2.0:1790100324.711598:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140907648 00000100:00100000:2.0:1790100324.711612:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100324.711619:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:6528:x1877056140907520:12345-0@lo:104: 00010000:00010000:2.0:1790100324.711631:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711676:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100324.711682:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:6528:x1877056140907520:12345-0@lo:104: Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.711689:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100324.711704:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790100324.711710:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+3:6528:x1877056140907648:12345-0@lo:104: 00010000:00010000:2.0:1790100324.711717:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711746:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790100324.711751:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+3:6528:x1877056140907648:12345-0@lo:104: Request processed in 42us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.711766:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1790100324.711785:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100324.711791:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711799:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189916000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100324.711803:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.711979:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100324.711990:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100324.711997:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100324.712031:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.712038:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100324.712058:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.712065:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189916000/0xc87a4f229828698f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286996 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.712077:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100324.712080:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.712096:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100324.712099:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.712107:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100324.712114:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100324.712119:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100324.712132:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.712138:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790100324.712488:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:9502:x1877056140907392:12345-0@lo:253: Request processed in 9638us (9740us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100324.712497:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790100324.712605:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140907904:0@lo:103: 00000100:00100000:1.0:1790100324.712637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100324.712698:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140907904 00000100:00100000:0.0:1790100324.712703:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140907904 00010000:00010000:0.0:1790100324.712723:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286949 expref: 17 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.712746:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790100324.712753:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a237a43-d248-40fc-b145-fd7f23146511+17:3641:x1877056140907904:12345-0@lo:103: 00010000:00010000:0.0:1790100324.712764:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100324.712768:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286949 expref: 17 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.712778:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286949 expref: 17 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100324.712793:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100324.712958:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.712966:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59200/0xc87a4f2298286949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286950 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.712980:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100324.712983:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100324.712985:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100324.712991:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100324.713000:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140907776:0@lo:103: 00000100:00100000:2.0:1790100324.713026:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100324.713058:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140907776 00000100:00100000:2.0:1790100324.713062:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140907776 00010000:00010000:2.0:1790100324.713083:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828698f expref: 18 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100324.713105:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790100324.713111:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+18:3644:x1877056140907776:12345-0@lo:103: 00010000:00010000:2.0:1790100324.713119:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100324.713123:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828698f expref: 18 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713131:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828698f expref: 18 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713142:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100324.713242:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a237a43-d248-40fc-b145-fd7f23146511+18:3641:x1877056140907904:12345-0@lo:103: Request processed in 488us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100324.713254:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1790100324.713298:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790100324.713312:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004801735s 00010000:00010000:2.0:1790100324.713317:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713325:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713333:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713364:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713371:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100324.713381:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713389:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713399:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713409:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100324.713441:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+17:3644:x1877056140907776:12345-0@lo:103: Request processed in 329us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100324.713447:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1790100324.713490:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189917400/0xc87a4f2298286996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828698f expref: 16 pid: 6505 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100324.713500:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b41f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140907520:0@lo:104: 00010000:00010000:2.0:1790100324.713510:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565dc00/0xc87a4f2298286950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286949 expref: 15 pid: 6507 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100324.713518:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b43480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877056140907648:0@lo:104: 00010000:00010000:2.0:1790100324.713534:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713543:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713549:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100324.713556:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180030000/0xc87a4f2298286a5a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100324.713690:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a237a43-d248-40fc-b145-fd7f23146511:9502:1877056140907392:0@lo:253: 10000000:01000000:3.0:1790100324.713701:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790100324.713704:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100324.713706:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790100324.713708:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100324.713709:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100324.713711:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100324.713712:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100324.713714:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100324.713715:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790100324.713716:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790100324.713718:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100324.713719:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790100324.713729:0:9502:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1790100324.713984:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140907776:0@lo:103: 00000100:00100000:1.0:1790100324.719956:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140907904:0@lo:103: 00080000:10000000:3.0:1790100324.721746:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1790100324.722330:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1790100324.722640:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1790100324.722787:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1790100324.723225:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1790100324.723571:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1790100324.724973:0:9502:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790100324.734608:0:9502:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790100324.734617:0:9502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790100324.734652:0:9502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790100324.734689:0:9502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790100324.734706:0:9502:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1790100324.734722:0:9502:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1790100324.736527:0:9502:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100324.736686:0:9502:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1790100325.193672:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790100325.333556:0:9575:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100325.333774:0:9575:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790100326.218039:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100327.240856:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100327.883649:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140908032:0@lo:13: 00000100:00100000:2.0:1790100327.883711:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100327.887247:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140908032 00000100:00100000:1.0:1790100327.887261:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140908032 00000100:00100000:1.0:1790100327.887326:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100327.887360:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140908032:12345-0@lo:13: 00002000:00000024:1.0:1790100327.887391:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100327.887464:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140908032:12345-0@lo:13: Request processed in 129us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100327.887471:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790100327.887501:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790100327.890273:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c1982a00 x1877056140908032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100327.890298:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140908032:0@lo:13: 00000100:00100000:2.0:1790100327.890327:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100327.890354:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140908160:0@lo:13: 00000100:00100000:2.0:1790100327.890408:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100327.890461:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140908160 00000100:00100000:2.0:1790100327.890467:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140908160 00000100:00100000:2.0:1790100327.890514:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100327.890523:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140908160:12345-0@lo:13: 00002000:00000024:2.0:1790100327.890541:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100327.890578:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140908160:12345-0@lo:13: Request processed in 56us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100327.890585:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790100327.890612:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c1981180 x1877056140908160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100327.890624:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140908160:0@lo:13: 00000100:00080000:2.0:1790100327.890643:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790100328.264554:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100328.393138:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140908288:0@lo:41: 00000100:00100000:3.0:1790100328.393216:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100328.393748:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140908288 00000100:00100000:3.0:1790100328.393755:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140908288 00000100:00100000:3.0:1790100328.393997:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790100328.394007:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140908288:12345-0@lo:41: 00000004:00000024:3.0:1790100328.394038:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1790100328.394088:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140908288:12345-0@lo:41: Request processed in 82us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100328.394095:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790100328.394183:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140908288:0@lo:41: 00000001:02000400:2.0:1790100328.761813:0:9865:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790100329.288592:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790100329.401138:0:9917:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790100329.401667:0:9917:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790100329.418472:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140908416:0@lo:41: 00000100:00100000:3.0:1790100329.418535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.418652:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140908416 00000100:00100000:1.0:1790100329.418661:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140908416 00000100:00100000:1.0:1790100329.418742:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790100329.418753:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140908416:12345-0@lo:41: 00000004:00000024:1.0:1790100329.418786:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1790100329.418853:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140908416:12345-0@lo:41: Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100329.418860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100329.419366:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140908416:0@lo:41: 00000100:00100000:1.0:1790100329.930793:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140908928:0@lo:400: 00000100:00100000:1.0:1790100329.930855:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.930914:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140909440:0@lo:400: 00000100:00100000:1.0:1790100329.930938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932081:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790100329.932094:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140908544:0@lo:400: 00000100:00100000:1.0:1790100329.932206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932245:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140909056:0@lo:400: 00000100:00100000:1.0:1790100329.932269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932289:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140909568:0@lo:400: 00000100:00100000:1.0:1790100329.932311:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932354:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140908672:0@lo:400: 00000100:00100000:1.0:1790100329.932390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932408:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140909184:0@lo:400: 00000100:00100000:1.0:1790100329.932428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932445:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140909696:0@lo:400: 00000100:00100000:1.0:1790100329.932467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932485:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790100329.932491:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140908800:0@lo:400: 00000100:00100000:1.0:1790100329.932512:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140909312:0@lo:400: 00000100:00100000:1.0:1790100329.932548:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932568:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140909824:0@lo:400: 00000100:00100000:1.0:1790100329.932590:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100329.932615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140908928 00000100:00100000:1.0:1790100329.932623:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140908928 00000100:00100000:2.0:1790100329.933209:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140908544 00000100:00100000:2.0:1790100329.933223:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140908544 00000100:00100000:2.0:1790100329.933259:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790100329.933268:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:3641:x1877056140908544:12345-0@lo:400: 00000100:00100000:2.0:1790100329.933327:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+15:3641:x1877056140908544:12345-0@lo:400: Request processed in 60us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100329.933334:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790100329.933926:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140908672 00000100:00100000:1.0:1790100329.933933:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140908672 00000100:00100000:1.0:1790100329.933948:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140909184 00000100:00100000:1.0:1790100329.933950:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140909184 00000100:00100000:1.0:1790100329.935961:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140909696 00000100:00100000:1.0:1790100329.935972:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140909696 00000100:00080000:2.0:1790100329.937172:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100329.937704:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140909312 00000100:00100000:1.0:1790100329.937712:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140909312 00000100:00080000:2.0:1790100329.937933:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100329.938151:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140909824 00000100:00100000:1.0:1790100329.938156:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140909824 00000100:00080000:2.0:1790100329.938183:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100329.938248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790100329.938258:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140908928:12345-0@lo:400: 00000100:00100000:1.0:1790100329.938330:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140908928:12345-0@lo:400: Request processed in 74us (7475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100329.938364:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790100329.938381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790100329.938387:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140908672:12345-0@lo:400: 00000100:00100000:1.0:1790100329.938432:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140908672:12345-0@lo:400: Request processed in 46us (6041us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100329.938438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790100329.938449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100329.938455:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140909184:12345-0@lo:400: 00000100:00100000:1.0:1790100329.938479:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140909184:12345-0@lo:400: Request processed in 25us (6050us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100329.938484:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100329.938506:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790100329.938511:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140909696:12345-0@lo:400: 00000100:00100000:1.0:1790100329.938548:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140909696:12345-0@lo:400: Request processed in 37us (6080us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100329.938553:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790100329.938564:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790100329.938569:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140909312:12345-0@lo:400: 00000100:00100000:1.0:1790100329.938593:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140909312:12345-0@lo:400: Request processed in 24us (6045us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100329.938598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790100329.938607:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100329.938612:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140909824:12345-0@lo:400: 00000100:00100000:1.0:1790100329.938631:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140909824:12345-0@lo:400: Request processed in 20us (6041us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100329.938636:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100329.938653:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140909440 00000100:00100000:1.0:1790100329.938657:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140909440 00010000:00080000:3.0:1790100329.938725:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c57b80 x1877056140909312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100329.938738:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140909312:0@lo:400: 00010000:00080000:3.0:1790100329.938778:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c56d80 x1877056140909824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100329.938786:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140909824:0@lo:400: 00010000:00080000:3.0:1790100329.938796:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92618683c000 x1877056140908672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100329.938803:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140908672:0@lo:400: 00010000:00080000:3.0:1790100329.938811:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c57100 x1877056140909184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100329.938817:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140909184:0@lo:400: 00010000:00080000:3.0:1790100329.938828:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c54e00 x1877056140909696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100329.938836:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140909696:0@lo:400: 00000100:00080000:2.0:1790100329.938948:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100329.939286:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140909568 00000100:00100000:1.0:1790100329.939291:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140909568 00000100:00100000:3.0:1790100329.939331:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100329.939361:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140909440:12345-0@lo:400: 00000100:00080000:2.0:1790100329.939401:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100329.939419:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140909440:12345-0@lo:400: Request processed in 79us (8478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100329.939424:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100329.939437:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100329.939444:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140909568:12345-0@lo:400: 00000100:00100000:3.0:1790100329.939476:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140909568:12345-0@lo:400: Request processed in 33us (7164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100329.939482:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100329.939669:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140909056 00000100:00100000:1.0:1790100329.939675:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140909056 00000100:00100000:1.0:1790100329.939702:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140908800 00000100:00100000:1.0:1790100329.939704:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140908800 00000100:00100000:1.0:1790100329.939716:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790100329.939722:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140909056:12345-0@lo:400: 00000100:00100000:2.0:1790100329.939823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790100329.939834:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140908800:12345-0@lo:400: 00000100:00100000:1.0:1790100329.939850:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140909056:12345-0@lo:400: Request processed in 126us (7579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100329.939861:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790100329.939906:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140908800:12345-0@lo:400: Request processed in 74us (7392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100329.939915:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790100329.939938:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140908544:0@lo:400: 00000100:00100000:2.0:1790100329.939954:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140908800:0@lo:400: 00000100:00100000:1.0:1790100329.939957:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140909056:0@lo:400: 00010000:00080000:1.0:1790100329.939975:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c54380 x1877056140909568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100329.939985:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140909568:0@lo:400: 00010000:00080000:1.0:1790100329.939997:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92618683d180 x1877056140908928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100329.940006:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140908928:0@lo:400: 00010000:00080000:1.0:1790100329.940018:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c56300 x1877056140909440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100329.940027:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140909440:0@lo:400: 00010000:00010000:0.0:1790100330.312597:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100331.336948:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790100331.519466:0:10018:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790100331.519842:0:10018:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1790100332.146757:0:10066:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100332.146767:0:10066:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1790100332.361574:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100333.000539:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790100333.000568:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140909952:0@lo:13: 00000100:00100000:3.0:1790100333.000632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100333.000689:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140909952 00000100:00100000:2.0:1790100333.000698:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140909952 00000100:00100000:3.0:1790100333.000707:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140910080:0@lo:13: 00000100:00100000:3.0:1790100333.000737:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100333.000778:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140910080 00000100:00100000:0.0:1790100333.000783:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140910080 00000100:00100000:2.0:1790100333.000840:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790100333.000849:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140909952:12345-0@lo:13: 00002000:00000024:2.0:1790100333.000885:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100333.000942:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140909952:12345-0@lo:13: Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100333.000948:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790100333.001073:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c1981180 x1877056140909952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100333.001089:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140909952:0@lo:13: 00000100:00100000:0.0:1790100333.001190:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790100333.001198:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140910080:12345-0@lo:13: 00002000:00000024:0.0:1790100333.001210:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100333.001253:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140910080:12345-0@lo:13: Request processed in 56us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100333.001259:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790100333.001310:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a636ad80 x1877056140910080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100333.001324:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140910080:0@lo:13: 00000100:00080000:1.0:1790100333.001406:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100333.384620:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100333.465030:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.465111:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127238528 00000100:00100000:3.0:1790100333.465122:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127238528 00000100:00100000:3.0:1790100333.465167:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:3.0:1790100333.465175:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2418:x1877056127238528:12345-192.168.203.13@tcp:250: 00010000:00080000:3.0:1790100333.465201:0:6506:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from de93b87c-aa02-4433-9e3b-35d1ec3ad5ae@192.168.203.13@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:3.0:1790100333.465227:0:6506:0:(genops.c:1384:class_connect()) connect: client de93b87c-aa02-4433-9e3b-35d1ec3ad5ae, cookie 0xc87a4f2298286a61 00000100:00080000:3.0:1790100333.465446:0:6506:0:(import.c:65:import_set_state_nolock()) ffff926083164800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100333.465515:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+5:2418:x1877056127238528:12345-192.168.203.13@tcp:250: Request processed in 339us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.465523:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:2.0:1790100333.473645:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.473714:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127238400 00000100:00100000:3.0:1790100333.473724:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127238400 00000100:00100000:3.0:1790100333.473776:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:3.0:1790100333.473801:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+5:6170:x1877056127238400:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1790100333.473819:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100333.473835:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230dfc3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.473875:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.473887:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.473896:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261c2178400, rc 0) 00000100:00100000:3.0:1790100333.473958:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+6:6170:x1877056127238400:12345-192.168.203.13@tcp:101: Request processed in 158us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.473965:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:0.0:1790100333.479074:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.479131:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127238656 00000100:00100000:3.0:1790100333.479141:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127238656 00000100:00100000:3.0:1790100333.479193:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:3.0:1790100333.479201:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+6:6170:x1877056127238656:12345-192.168.203.13@tcp:501: 00000100:00100000:3.0:1790100333.479307:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+6:6170:x1877056127238656:12345-192.168.203.13@tcp:501: Request processed in 107us (241us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790100333.479315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:0.0:1790100333.482489:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.482594:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127238784 00000100:00100000:3.0:1790100333.482603:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127238784 00000100:00100000:3.0:1790100333.482657:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:3.0:1790100333.482667:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+6:6170:x1877056127238784:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1790100333.482681:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100333.482707:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230dfca expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.482732:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.482744:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.482754:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261c2179400, rc 0) 00000100:00100000:3.0:1790100333.482929:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+7:6170:x1877056127238784:12345-192.168.203.13@tcp:101: Request processed in 262us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.482936:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:2.0:1790100333.485720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.485915:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127238912 00000100:00100000:3.0:1790100333.485924:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127238912 00000100:00100000:3.0:1790100333.485976:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:3.0:1790100333.485986:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+7:6170:x1877056127238912:12345-192.168.203.13@tcp:501: 00000100:00100000:3.0:1790100333.486128:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:6170:x1877056127238912:12345-192.168.203.13@tcp:501: Request processed in 143us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.486136:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:0.0:1790100333.487191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.487256:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127239040 00000100:00100000:3.0:1790100333.487261:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127239040 00000100:00100000:3.0:1790100333.487294:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:3.0:1790100333.487301:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:6170:x1877056127239040:12345-192.168.203.13@tcp:503: 00000100:00100000:3.0:1790100333.487569:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:6170:x1877056127239040:12345-192.168.203.13@tcp:503: Request processed in 267us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.487577:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:0.0:1790100333.490090:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.490209:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127239168 00000100:00100000:3.0:1790100333.490228:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127239168 00000100:00100000:3.0:1790100333.490278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:3.0:1790100333.490287:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:6189:x1877056127239168:12345-192.168.203.13@tcp:502: 00000100:00100000:3.0:1790100333.490464:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:6189:x1877056127239168:12345-192.168.203.13@tcp:502: Request processed in 177us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.490472:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:2.0:1790100333.510594:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.510908:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127239296 00000100:00100000:3.0:1790100333.510918:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127239296 00000100:00100000:3.0:1790100333.510976:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:3.0:1790100333.510986:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:6189:x1877056127239296:12345-192.168.203.13@tcp:502: 00000100:00100000:3.0:1790100333.511613:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:6189:x1877056127239296:12345-192.168.203.13@tcp:502: Request processed in 626us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.511622:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:3.0:1790100333.513898:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140910208:0@lo:41: 00000100:00100000:3.0:1790100333.513959:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100333.515157:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140910208 00000100:00100000:1.0:1790100333.515166:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140910208 00000100:00100000:1.0:1790100333.515226:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790100333.515236:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140910208:12345-0@lo:41: 00000004:00000024:1.0:1790100333.515269:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1790100333.516122:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100333.516166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127239424 00000100:00100000:2.0:1790100333.516171:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127239424 00000100:00100000:2.0:1790100333.516204:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:2.0:1790100333.516212:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:6170:x1877056127239424:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1790100333.516224:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100333.516242:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926180030a00/0xc87a4f2298286a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230dffb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100333.516271:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926180030a00/0xc87a4f2298286a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dffb expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100333.516282:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926180030a00/0xc87a4f2298286a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dffb expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100333.516290:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030a00, rc 0) 00000100:00100000:2.0:1790100333.516327:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6170:x1877056127239424:12345-192.168.203.13@tcp:101: Request processed in 115us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100333.516333:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:1.0:1790100333.518574:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140910208:12345-0@lo:41: Request processed in 3332us (4608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.518583:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140910208:0@lo:41: 00000100:00100000:1.0:1790100333.518591:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790100333.521763:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100333.522062:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127239552 00000100:00100000:0.0:1790100333.522070:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127239552 00000100:00100000:0.0:1790100333.522112:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:0.0:1790100333.522119:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6170:x1877056127239552:12345-192.168.203.13@tcp:256: 20000000:01000000:0.0:1790100333.522141:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790100333.522160:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790100333.522166:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790100333.522169:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790100333.522172:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790100333.522174:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1790100333.523826:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6170:x1877056127239552:12345-192.168.203.13@tcp:256: Request processed in 1701us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100333.523835:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:2.0:1790100333.525955:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.526048:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127239680 00000100:00100000:3.0:1790100333.526057:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127239680 00000100:00100000:3.0:1790100333.526115:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1790100333.526126:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6170:x1877056127239680:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1790100333.526141:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100333.526158:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e002 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.526183:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.526212:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100333.526221:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261c2179200, rc 0) 00000100:00100000:3.0:1790100333.526276:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6170:x1877056127239680:12345-192.168.203.13@tcp:101: Request processed in 153us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.526284:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:2.0:1790100333.528408:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100333.528485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127239808 00000100:00100000:0.0:1790100333.528493:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127239808 00000100:00100000:0.0:1790100333.528573:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:0.0:1790100333.528581:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6170:x1877056127239808:12345-192.168.203.13@tcp:501: 00000100:00100000:0.0:1790100333.528689:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6170:x1877056127239808:12345-192.168.203.13@tcp:501: Request processed in 109us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100333.528694:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:0.0:1790100333.530920:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100333.531150:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127239936 00000100:00100000:2.0:1790100333.531158:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127239936 00000100:00100000:2.0:1790100333.531195:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:2.0:1790100333.531201:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6170:x1877056127239936:12345-192.168.203.13@tcp:503: 00000100:00100000:2.0:1790100333.531373:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6170:x1877056127239936:12345-192.168.203.13@tcp:503: Request processed in 170us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100333.531381:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:2.0:1790100333.534936:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100333.535008:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127240064 00000100:00100000:0.0:1790100333.535016:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127240064 00000100:00100000:0.0:1790100333.535075:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:0.0:1790100333.535083:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6194:x1877056127240064:12345-192.168.203.13@tcp:502: 00000100:00100000:0.0:1790100333.535212:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6194:x1877056127240064:12345-192.168.203.13@tcp:502: Request processed in 130us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100333.535218:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:0.0:1790100333.538502:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100333.538586:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127240192 00000100:00100000:3.0:1790100333.538596:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127240192 00000100:00100000:3.0:1790100333.538678:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:3.0:1790100333.538688:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6194:x1877056127240192:12345-192.168.203.13@tcp:502: 00000100:00100000:3.0:1790100333.538838:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6194:x1877056127240192:12345-192.168.203.13@tcp:502: Request processed in 152us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.538845:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:1.0:1790100333.543086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100333.543177:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100333.543607:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127240320 00000100:00100000:2.0:1790100333.543617:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127240320 00000100:00100000:2.0:1790100333.543654:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127240576 00000100:00100000:2.0:1790100333.543657:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127240576 00000100:00100000:2.0:1790100333.543673:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790100333.543682:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2418:x1877056127240320:12345-192.168.203.13@tcp:38: 00010000:00080000:2.0:1790100333.543708:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1790100333.543750:0:6512:0:(genops.c:1384:class_connect()) connect: client e84eb833-b466-4273-a7db-c12bb35adfb4, cookie 0xc87a4f2298286a84 00000004:00100000:2.0:1790100333.543770:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1790100333.543973:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790100333.543979:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2418:x1877056127240576:12345-192.168.203.13@tcp:38: 00010000:00080000:1.0:1790100333.544009:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:1.0:1790100333.544046:0:6513:0:(genops.c:1384:class_connect()) connect: client e84eb833-b466-4273-a7db-c12bb35adfb4, cookie 0xc87a4f2298286a8b 00000004:00100000:1.0:1790100333.544058:0:6513:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790100333.544217:0:6513:0:(import.c:65:import_set_state_nolock()) ffff926083266000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100333.544272:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2418:x1877056127240576:12345-192.168.203.13@tcp:38: Request processed in 291us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100333.544280:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00080000:2.0:1790100333.544516:0:6512:0:(import.c:65:import_set_state_nolock()) ffff926083b41000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100333.544550:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2418:x1877056127240320:12345-192.168.203.13@tcp:38: Request processed in 869us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100333.544558:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00010000:00010000:3.0:1790100334.408558:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100334.536627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100334.536657:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140910336:0@lo:41: 00000100:00100000:3.0:1790100334.536725:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100334.536895:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140910336 00000100:00100000:2.0:1790100334.536903:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140910336 00000100:00100000:2.0:1790100334.536948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790100334.536956:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140910336:12345-0@lo:41: 00000004:00000024:2.0:1790100334.536986:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1790100334.537040:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140910336:12345-0@lo:41: Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100334.537047:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790100334.537820:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140910336:0@lo:41: 00000100:00100000:1.0:1790100334.548600:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100334.548641:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100334.548899:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100334.549113:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127240704 00000100:00100000:0.0:1790100334.549113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127240448 00000100:00100000:0.0:1790100334.549124:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127240448 00000100:00100000:2.0:1790100334.549132:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127240704 00000100:00100000:0.0:1790100334.549248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127240832 00000100:00100000:0.0:1790100334.549252:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127240832 00000100:00100000:0.0:1790100334.549271:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790100334.549287:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:0:x1877056127240448:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1790100334.549326:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1790100334.549409:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:0:x1877056127240448:12345-192.168.203.13@tcp:41: Request processed in 124us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100334.549416:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790100334.549444:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790100334.549452:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6170:x1877056127240832:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1790100334.549463:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1790100334.549486:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6170:x1877056127240832:12345-192.168.203.13@tcp:41: Request processed in 35us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100334.549493:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790100334.549676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1790100334.549684:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:0:x1877056127240704:12345-192.168.203.13@tcp:41: 00000004:00000024:2.0:1790100334.549995:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1790100334.550027:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:0:x1877056127240704:12345-192.168.203.13@tcp:41: Request processed in 343us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100334.550033:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00080000:1.0:1790100334.550073:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100334.550078:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100334.552184:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100334.552286:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127240960 00000100:00100000:3.0:1790100334.552294:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127240960 00000100:00100000:3.0:1790100334.552400:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1790100334.552410:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6170:x1877056127240960:12345-192.168.203.13@tcp:40: 00000100:00100000:3.0:1790100334.552489:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6170:x1877056127240960:12345-192.168.203.13@tcp:40: Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100334.552508:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1790100334.554480:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100334.554567:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127241088 00000100:00100000:1.0:1790100334.554575:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127241088 00000100:00100000:1.0:1790100334.554617:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790100334.554624:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2418:x1877056127241088:12345-192.168.203.13@tcp:8: 00010000:00080000:1.0:1790100334.555063:0:8426:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1790100334.555092:0:8426:0:(genops.c:1384:class_connect()) connect: client e84eb833-b466-4273-a7db-c12bb35adfb4, cookie 0xc87a4f2298286a92 00002000:00100000:1.0:1790100334.555104:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e84eb833-b466-4273-a7db-c12bb35adfb4/ffff926083260000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790100334.555115:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790100334.555296:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790100334.555325:0:8426:0:(import.c:65:import_set_state_nolock()) ffff926083262000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100334.555417:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2418:x1877056127241088:12345-192.168.203.13@tcp:8: Request processed in 791us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100334.555425:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1790100334.555524:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100334.555580:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127241344 00000100:00100000:3.0:1790100334.555586:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127241344 00000100:00100000:2.0:1790100334.555608:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100334.555627:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:3.0:1790100334.555636:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127241344:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1790100334.555669:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127241344:12345-192.168.203.13@tcp:400: Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100334.555675:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:3.0:1790100334.555718:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127241216 00000100:00100000:3.0:1790100334.555722:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127241216 00000100:00100000:3.0:1790100334.555747:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1790100334.555753:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2418:x1877056127241216:12345-192.168.203.13@tcp:8: 00010000:00080000:3.0:1790100334.555770:0:8425:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1790100334.555793:0:8425:0:(genops.c:1384:class_connect()) connect: client e84eb833-b466-4273-a7db-c12bb35adfb4, cookie 0xc87a4f2298286a99 00002000:00100000:3.0:1790100334.555800:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e84eb833-b466-4273-a7db-c12bb35adfb4/ffff926083165000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790100334.555812:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790100334.556088:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790100334.556108:0:8425:0:(import.c:65:import_set_state_nolock()) ffff926083160800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100334.556134:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2418:x1877056127241216:12345-192.168.203.13@tcp:8: Request processed in 380us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100334.556140:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1790100334.559280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100334.559465:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127241472 00000100:00100000:1.0:1790100334.559483:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127241472 00000100:00100000:1.0:1790100334.559525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1790100334.559531:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6170:x1877056127241472:12345-192.168.203.13@tcp:900: 00000100:00100000:1.0:1790100334.559590:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6170:x1877056127241472:12345-192.168.203.13@tcp:900: Request processed in 59us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100334.559598:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1790100334.562036:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100334.562095:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127241600 00000100:00100000:0.0:1790100334.562104:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127241600 00000100:00100000:0.0:1790100334.562156:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790100334.562166:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6170:x1877056127241600:12345-192.168.203.13@tcp:33: 00000004:00080000:0.0:1790100334.580227:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17979us 00000004:00200000:0.0:1790100334.589115:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790100334.589230:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6170:x1877056127241600:12345-192.168.203.13@tcp:33: Request processed in 27060us (27197us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100334.589241:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790100334.740644:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100334.744904:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127241728 00000100:00100000:2.0:1790100334.744921:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127241728 00000100:00100000:2.0:1790100334.744997:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1790100334.745008:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6212:x1877056127241728:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1790100334.745028:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100334.745084:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298286aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e033 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100334.745162:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298286aa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100334.745176:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298286aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100334.745191:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298286aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100334.745245:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790100334.745249:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100334.745280:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298286aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100334.745305:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298286aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e033 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100334.745325:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298286aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e033 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100334.745333:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6194a00) 00010000:00010000:2.0:1790100334.745336:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100334.745393:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030c00, rc 0) 00000100:00100000:2.0:1790100334.745458:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:6212:x1877056127241728:12345-192.168.203.13@tcp:101: Request processed in 452us (4823us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100334.745465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 10000000:01000000:1.0:1790100335.048462:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790100335.048470:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b6950800 from 39 10000000:01000000:1.0:1790100335.048475:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100335.048518:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.048531:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.048542:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100335.048565:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140910464:0@lo:101: 00000100:00100000:1.0:1790100335.048630:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.048733:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140910464 00000100:00100000:2.0:1790100335.048741:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140910464 00000100:00100000:2.0:1790100335.048800:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790100335.048811:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140910464:12345-0@lo:101: 00010000:00010000:2.0:1790100335.048823:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100335.048837:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286aae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100335.048872:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286aae expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100335.048884:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286aae expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100335.048893:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030000, rc 0) 00000100:00100000:3.0:1790100335.048907:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056140910592:0@lo:400: 00000100:00100000:3.0:1790100335.048948:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.048960:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140910464:12345-0@lo:101: Request processed in 150us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.048968:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790100335.049001:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.049003:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140910976:0@lo:400: 00000100:00100000:1.0:1790100335.049028:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140910464:0@lo:101: 00000100:00100000:2.0:1790100335.049037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790100335.049044:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.049055:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100335.049062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140911488:0@lo:400: 00000100:00100000:2.0:1790100335.049087:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.049121:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140910720:0@lo:400: 00000100:00100000:1.0:1790100335.049129:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140911872:0@lo:501: 00000100:00100000:2.0:1790100335.049150:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.049166:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.049174:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140911232:0@lo:400: 00000100:00100000:1.0:1790100335.049188:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.049199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.049218:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140911744:0@lo:400: 00000100:00100000:2.0:1790100335.049237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.049254:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790100335.049259:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140910848:0@lo:400: 00000100:00100000:2.0:1790100335.049278:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.049294:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140911360:0@lo:400: 00000100:00100000:2.0:1790100335.049327:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.049380:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140910976 00000100:00100000:2.0:1790100335.049384:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140910976 00000100:00100000:2.0:1790100335.049408:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140910720 00000100:00100000:2.0:1790100335.049411:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140910720 00000100:00100000:2.0:1790100335.049425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100335.049431:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140910976:12345-0@lo:400: 00000100:00100000:2.0:1790100335.049469:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140910976:12345-0@lo:400: Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.049497:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100335.049510:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100335.049516:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140910720:12345-0@lo:400: 00000100:00100000:2.0:1790100335.049550:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140910720:12345-0@lo:400: Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.049556:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790100335.053541:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140910592 00000100:00100000:0.0:1790100335.053558:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140910592 00000100:00100000:0.0:1790100335.053617:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140911232 00000100:00100000:0.0:1790100335.053620:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140911232 00000100:00100000:0.0:1790100335.053653:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140911744 00000100:00100000:0.0:1790100335.053656:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140911744 00000100:00100000:0.0:1790100335.053670:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140910848 00000100:00100000:0.0:1790100335.053672:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140910848 00000100:00100000:0.0:1790100335.053689:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790100335.053698:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056140910592:12345-0@lo:400: 00000100:00100000:0.0:1790100335.053832:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056140910592:12345-0@lo:400: Request processed in 135us (4884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.053839:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790100335.053866:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790100335.053873:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140911232:12345-0@lo:400: 00000100:00100000:0.0:1790100335.053900:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140911232:12345-0@lo:400: Request processed in 29us (4702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.053905:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790100335.053915:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790100335.053921:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140911744:12345-0@lo:400: 00000100:00100000:0.0:1790100335.053947:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140911744:12345-0@lo:400: Request processed in 27us (4709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.053952:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790100335.053962:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790100335.053968:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140910848:12345-0@lo:400: 00000100:00100000:0.0:1790100335.053992:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140910848:12345-0@lo:400: Request processed in 25us (4713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.053997:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790100335.054018:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140911872 00000100:00100000:0.0:1790100335.054028:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140911872 00000100:00100000:0.0:1790100335.054056:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790100335.054062:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140911872:12345-0@lo:501: 00000100:00100000:0.0:1790100335.054176:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140911872:12345-0@lo:501: Request processed in 113us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.054182:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790100335.054229:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140911872:0@lo:501: 00000100:00100000:0.0:1790100335.054277:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140912000:0@lo:503: 00000100:00100000:0.0:1790100335.054316:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.054378:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.054390:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140912000 00000100:00100000:2.0:1790100335.054887:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140910976:0@lo:400: 00000100:00100000:2.0:1790100335.054917:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140910848:0@lo:400: 00000100:00100000:2.0:1790100335.054927:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140910720:0@lo:400: 00010000:00080000:2.0:1790100335.054939:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92618683d180 x1877056140911232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100335.054950:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140911232:0@lo:400: 00010000:00080000:2.0:1790100335.054959:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926082132a00 x1877056140911744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100335.054966:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140911744:0@lo:400: 00000100:00100000:2.0:1790100335.055029:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140911488 00000100:00100000:2.0:1790100335.055033:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140911488 00000100:00100000:2.0:1790100335.055071:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140911360 00000100:00100000:2.0:1790100335.055075:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140911360 00000100:00100000:2.0:1790100335.055092:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100335.055098:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140911488:12345-0@lo:400: 00000100:00100000:2.0:1790100335.055142:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140911488:12345-0@lo:400: Request processed in 45us (6055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.055149:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100335.055171:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100335.055178:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140911360:12345-0@lo:400: 00000100:00100000:2.0:1790100335.055212:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140911360:12345-0@lo:400: Request processed in 34us (5885us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.055218:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1790100335.055242:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92618683d880 x1877056140911488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100335.055252:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140911488:0@lo:400: 00010000:00080000:2.0:1790100335.055279:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92618683ea00 x1877056140911360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100335.055287:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140911360:0@lo:400: 00000100:00080000:2.0:1790100335.055330:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100335.055335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100335.056802:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140912000 00000100:00100000:0.0:1790100335.056874:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790100335.056884:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140912000:12345-0@lo:503: 00000100:00100000:0.0:1790100335.057023:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140912000:12345-0@lo:503: Request processed in 141us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.057030:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790100335.057088:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140912000:0@lo:503: 00000100:00100000:0.0:1790100335.057298:0:10080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10080:1877056140912128:0@lo:502: 00000100:00100000:0.0:1790100335.057357:0:10080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.057379:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140912128 00000100:00100000:0.0:1790100335.057384:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140912128 00000100:00100000:0.0:1790100335.057400:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790100335.057408:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:10080:x1877056140912128:12345-0@lo:502: 00000100:00100000:0.0:1790100335.057478:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:10080:x1877056140912128:12345-0@lo:502: Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.057489:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790100335.057518:0:10080:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.057530:0:10080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10080:1877056140912128:0@lo:502: 00000100:00100000:0.0:1790100335.057572:0:10080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10080:1877056140912256:0@lo:502: 00000100:00100000:0.0:1790100335.057601:0:10080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.057615:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056140910592:0@lo:400: 00000100:00100000:0.0:1790100335.057617:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140912256 00000100:00100000:0.0:1790100335.057620:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140912256 00000100:00100000:3.0:1790100335.057629:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056140911104:0@lo:400: 00000100:00100000:0.0:1790100335.057634:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790100335.057638:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:10080:x1877056140912256:12345-0@lo:502: 00000100:00100000:3.0:1790100335.057655:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.057692:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:10080:x1877056140912256:12345-0@lo:502: Request processed in 52us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.057698:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790100335.057724:0:10080:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.057735:0:10080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10080:1877056140912256:0@lo:502: 00000040:00080000:0.0:1790100335.057753:0:10080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:3.0:1790100335.057788:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140911104 00000100:00100000:3.0:1790100335.057792:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140911104 00000020:01000000:0.0:1790100335.057812:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 00000100:00100000:3.0:1790100335.057825:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790100335.057830:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877056140911104:12345-0@lo:400: 10000000:01000000:0.0:1790100335.057834:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100335.057843:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.057865:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.057874:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877056140911104:12345-0@lo:400: Request processed in 44us (218us total) trans 0 rc 0/0 10000000:01000000:0.0:1790100335.057875:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790100335.057877:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 00000100:00100000:3.0:1790100335.057879:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 10000000:01000000:0.0:1790100335.057880:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000100:00080000:3.0:1790100335.057896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790100335.057905:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.057913:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056140911104:0@lo:400: 00010000:00010000:0.0:1790100335.057913:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.057919:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056140911616:0@lo:400: 00010000:00010000:0.0:1790100335.057921:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100335.057932:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140912384:0@lo:101: 00000100:00100000:3.0:1790100335.057939:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.057952:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.057958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140911616 00000100:00100000:3.0:1790100335.057961:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140911616 00000100:00100000:0.0:1790100335.057963:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.057974:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140912384 00000100:00100000:0.0:1790100335.057976:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140912384 00000100:00100000:3.0:1790100335.057987:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790100335.057989:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790100335.057993:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056140911616:12345-0@lo:400: 00000100:00100000:0.0:1790100335.057993:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140912384:12345-0@lo:101: 00010000:00010000:0.0:1790100335.058000:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100335.058009:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286abc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.058028:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286abc expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.058038:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286abc expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.058046:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e59200, rc 0) 00000100:00080000:2.0:1790100335.058129:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100335.058149:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056140911616:0@lo:400: 00000100:00100000:0.0:1790100335.060945:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140912384:12345-0@lo:101: Request processed in 2941us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.060956:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790100335.063889:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056140911616:12345-0@lo:400: Request processed in 5886us (5939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100335.064182:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790100335.064256:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140912384:0@lo:101: 00010000:00010000:2.0:1790100335.064284:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100335.064308:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100335.064426:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140912512:0@lo:501: 00000100:00100000:2.0:1790100335.064702:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.064740:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261c1906240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.065827:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140912512 00000100:00100000:0.0:1790100335.065838:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140912512 00000100:00100000:0.0:1790100335.065963:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790100335.065974:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140912512:12345-0@lo:501: 00000100:00100000:0.0:1790100335.066131:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140912512:12345-0@lo:501: Request processed in 158us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.066139:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790100335.066234:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140912512:0@lo:501: 00000100:00100000:1.0:1790100335.066276:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140912640:0@lo:503: 00000100:00100000:1.0:1790100335.066324:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.079349:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.079495:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140912640 00000100:00100000:2.0:1790100335.079519:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140912640 00000100:00100000:2.0:1790100335.079560:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790100335.079568:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140912640:12345-0@lo:503: 00000100:00100000:2.0:1790100335.079714:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140912640:12345-0@lo:503: Request processed in 146us (13389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.079722:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790100335.080194:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140912640:0@lo:503: 00000100:00100000:1.0:1790100335.080439:0:10081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10081:1877056140912768:0@lo:502: 00000100:00100000:1.0:1790100335.080486:0:10081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.080516:0:10081:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.080542:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140912768 00000100:00100000:1.0:1790100335.080546:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140912768 00000100:00100000:1.0:1790100335.080566:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790100335.080572:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:10081:x1877056140912768:12345-0@lo:502: 00000100:00100000:1.0:1790100335.080653:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:10081:x1877056140912768:12345-0@lo:502: Request processed in 80us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.080659:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790100335.080692:0:10081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10081:1877056140912768:0@lo:502: 00000020:01000000:1.0:1790100335.080710:0:10081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100335.080719:0:10081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100335.080721:0:10081:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790100335.080726:0:10081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790100335.080728:0:10081:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790100335.080744:0:10081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10081:1877056140912896:0@lo:502: 00000100:00100000:1.0:1790100335.080769:0:10081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.080784:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140912896 00000100:00100000:1.0:1790100335.080787:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140912896 00000100:00100000:1.0:1790100335.080801:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790100335.080805:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:10081:x1877056140912896:12345-0@lo:502: 00000100:00100000:1.0:1790100335.080866:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:10081:x1877056140912896:12345-0@lo:502: Request processed in 59us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.080872:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790100335.080899:0:10081:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.080908:0:10081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10081:1877056140912896:0@lo:502: 00000020:01000000:1.0:1790100335.080922:0:10081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100335.080925:0:10081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100335.080927:0:10081:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790100335.080930:0:10081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1790100335.080974:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790100335.080989:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790100335.080998:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.081008:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100335.081017:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790100335.081019:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b2026000 from 39 10000000:01000000:1.0:1790100335.081022:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100335.081042:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.081058:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.081068:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100335.081080:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913024:0@lo:101: 00000100:00100000:1.0:1790100335.081106:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.081119:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.081130:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140913024 00000100:00100000:1.0:1790100335.081133:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140913024 00000100:00100000:1.0:1790100335.081148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790100335.081154:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140913024:12345-0@lo:101: 00010000:00010000:1.0:1790100335.081162:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100335.081172:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286aca expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.081191:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286aca expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.081200:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286aca expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.081207:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189916000, rc 0) 00000100:00100000:1.0:1790100335.081232:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140913024:12345-0@lo:101: Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.081238:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790100335.081265:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913024:0@lo:101: 00010000:00010000:1.0:1790100335.081281:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.081288:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100335.081323:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913152:0@lo:501: 00000100:00100000:1.0:1790100335.081367:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.081380:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.081391:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140913152 00000100:00100000:1.0:1790100335.081395:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140913152 00000100:00100000:1.0:1790100335.081409:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790100335.081414:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140913152:12345-0@lo:501: 00000100:00100000:1.0:1790100335.081491:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140913152:12345-0@lo:501: Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.081498:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790100335.081519:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913152:0@lo:501: 00000100:00100000:1.0:1790100335.081538:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913280:0@lo:503: 00000100:00100000:1.0:1790100335.081565:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.081576:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.081585:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140913280 00000100:00100000:1.0:1790100335.081588:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140913280 00000100:00100000:1.0:1790100335.081600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790100335.081605:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140913280:12345-0@lo:503: 00000100:00100000:1.0:1790100335.081658:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140913280:12345-0@lo:503: Request processed in 52us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.081664:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790100335.081696:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913280:0@lo:503: 00000100:00100000:1.0:1790100335.081906:0:10082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10082:1877056140913408:0@lo:502: 00000100:00100000:1.0:1790100335.081936:0:10082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.081953:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140913408 00000100:00100000:1.0:1790100335.081956:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140913408 00000100:00100000:1.0:1790100335.081971:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790100335.081977:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:10082:x1877056140913408:12345-0@lo:502: 00000100:00100000:1.0:1790100335.082037:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:10082:x1877056140913408:12345-0@lo:502: Request processed in 60us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.082043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790100335.082068:0:10082:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6480 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.082078:0:10082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10082:1877056140913408:0@lo:502: 00000100:00100000:1.0:1790100335.082111:0:10082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10082:1877056140913536:0@lo:502: 00000100:00100000:1.0:1790100335.082140:0:10082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.082157:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140913536 00000100:00100000:1.0:1790100335.082160:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140913536 00000100:00100000:1.0:1790100335.082175:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790100335.082180:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:10082:x1877056140913536:12345-0@lo:502: 00000100:00100000:1.0:1790100335.082233:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:10082:x1877056140913536:12345-0@lo:502: Request processed in 52us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.082238:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790100335.082261:0:10082:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.082271:0:10082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10082:1877056140913536:0@lo:502: 00000040:00080000:1.0:1790100335.082286:0:10082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1790100335.082320:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1790100335.082375:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790100335.082383:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.082391:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100335.082398:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790100335.082400:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9261b2026000 from 6 10000000:01000000:1.0:1790100335.082403:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100335.082420:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.082428:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.082436:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100335.082447:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913664:0@lo:101: 00000100:00100000:1.0:1790100335.082469:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.082482:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.082493:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140913664 00000100:00100000:1.0:1790100335.082497:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140913664 00000100:00100000:1.0:1790100335.082512:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790100335.082518:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140913664:12345-0@lo:101: 00010000:00010000:1.0:1790100335.082524:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100335.082532:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189917e00/0xc87a4f2298286adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286ad8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.082556:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189917e00/0xc87a4f2298286adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286ad8 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.082564:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189917e00/0xc87a4f2298286adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286ad8 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.082571:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189917e00, rc 0) 00000100:00100000:1.0:1790100335.082597:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140913664:12345-0@lo:101: Request processed in 79us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.082602:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790100335.082629:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913664:0@lo:101: 00010000:00010000:1.0:1790100335.082638:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.082646:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100335.082683:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913792:0@lo:256: 00000100:00100000:1.0:1790100335.082709:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.082722:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.082731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140913792 00000100:00100000:1.0:1790100335.082734:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140913792 00000100:00100000:1.0:1790100335.082749:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790100335.082754:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140913792:12345-0@lo:256: 20000000:01000000:1.0:1790100335.082765:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790100335.082780:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790100335.082783:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1790100335.082871:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140913792:12345-0@lo:256: Request processed in 116us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.082877:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790100335.082904:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913792:0@lo:256: 10000000:01000000:1.0:1790100335.086238:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790100335.086255:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.086268:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100335.086278:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1790100335.086281:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1790100335.086284:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790100335.086323:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.086332:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.086526:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100335.086548:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913920:0@lo:101: 00000100:00100000:1.0:1790100335.086610:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.086821:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.087087:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140913920 00000100:00100000:0.0:1790100335.087095:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140913920 00000100:00100000:0.0:1790100335.087172:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790100335.087182:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140913920:12345-0@lo:101: 00010000:00010000:0.0:1790100335.087195:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100335.087207:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286ae6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.087229:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.087238:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.087247:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e59800, rc 0) 00000100:00100000:0.0:1790100335.087296:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140913920:12345-0@lo:101: Request processed in 115us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.087301:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790100335.087492:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140913920:0@lo:101: 00010000:00010000:1.0:1790100335.087506:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.087530:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100335.087589:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140914048:0@lo:501: 00000100:00100000:1.0:1790100335.087626:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.087865:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.087938:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140914048 00000100:00100000:2.0:1790100335.087943:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140914048 00000100:00100000:2.0:1790100335.087975:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790100335.087982:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140914048:12345-0@lo:501: 00000100:00100000:2.0:1790100335.088129:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140914048:12345-0@lo:501: Request processed in 147us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.088135:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790100335.088289:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140914048:0@lo:501: 00000100:00100000:1.0:1790100335.088324:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140914176:0@lo:503: 00000100:00100000:1.0:1790100335.088402:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.088425:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.088532:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140914176 00000100:00100000:2.0:1790100335.088537:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140914176 00000100:00100000:2.0:1790100335.088562:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790100335.088575:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140914176:12345-0@lo:503: 00000100:00100000:2.0:1790100335.088779:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140914176:12345-0@lo:503: Request processed in 210us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.088786:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790100335.088862:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140914176:0@lo:503: 00000100:00100000:1.0:1790100335.089375:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10083:1877056140914304:0@lo:502: 00000100:00100000:1.0:1790100335.089418:0:10083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.089444:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.089494:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140914304 00000100:00100000:2.0:1790100335.089499:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140914304 00000100:00100000:2.0:1790100335.089519:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790100335.089525:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:10083:x1877056140914304:12345-0@lo:502: 00000100:00100000:2.0:1790100335.089667:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:10083:x1877056140914304:12345-0@lo:502: Request processed in 135us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.089682:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790100335.090140:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10083:1877056140914304:0@lo:502: 00000020:01000000:1.0:1790100335.090167:0:10083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790100335.090174:0:10083:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790100335.090181:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100335.090183:0:10083:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790100335.090188:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790100335.090192:0:10083:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1790100335.090214:0:10083:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790100335.090217:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100335.090241:0:10083:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9261b79fb380) 00000020:00000080:1.0:1790100335.090268:0:10083:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1790100335.090279:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790100335.090577:0:10083:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1790100335.090583:0:10083:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790100335.090589:0:10083:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f2298286afb 00010000:00080000:1.0:1790100335.090616:0:10083:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261bf974800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790100335.090991:0:10083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1790100335.091178:0:10083:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1790100335.091189:0:10083:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1790100335.091483:0:10083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100335.091597:0:10083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100335.091779:0:10083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1790100335.091874:0:10083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790100335.092315:0:10084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100335.092319:0:10084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790100335.093187:0:10083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790100335.093198:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790100335.093233:0:10083:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790100335.093254:0:10083:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298286b02 00000100:00080000:1.0:1790100335.093264:0:10083:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790100335.093274:0:10083:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9261bf974800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100335.093305:0:10083:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c57b80 x1877056140914432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100335.093335:0:10083:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790100335.093588:0:10083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100335.093593:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100335.093595:0:10083:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790100335.093598:0:10083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100335.093602:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100335.093603:0:10083:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790100335.093606:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790100335.093608:0:10083:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790100335.093633:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10083:1877056140914560:0@lo:502: 00000100:00100000:1.0:1790100335.093711:0:10083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.093754:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100335.093834:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056140914432:0@lo:8: 00000100:00100000:3.0:1790100335.093887:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.093949:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140914560 00000100:00100000:3.0:1790100335.093956:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140914560 00000100:00100000:3.0:1790100335.094000:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790100335.094009:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:10083:x1877056140914560:12345-0@lo:502: 00000100:00100000:3.0:1790100335.094129:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:10083:x1877056140914560:12345-0@lo:502: Request processed in 121us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100335.094137:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790100335.094369:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140914432 00000100:00100000:1.0:1790100335.094373:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140914432 00000100:00100000:1.0:1790100335.094394:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100335.094399:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1877056140914432:12345-0@lo:8: 00010000:00080000:1.0:1790100335.094424:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1790100335.094450:0:8427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298286b09 00002000:00100000:1.0:1790100335.094462:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9261bf972800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1790100335.094466:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1790100335.094470:0:8427:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1790100335.094519:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790100335.094641:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1790100335.094665:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9261bf975800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100335.094704:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1877056140914432:12345-0@lo:8: Request processed in 303us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.094711:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100335.094745:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10083:1877056140914560:0@lo:502: 00000020:01000000:1.0:1790100335.094772:0:10083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100335.094777:0:10083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100335.094779:0:10083:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790100335.094784:0:10083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00010000:00080000:3.0:1790100335.095002:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c57b80 x1877056140914432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100335.095011:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100335.095017:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1790100335.095024:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790100335.095038:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790100335.095041:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261bf974800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790100335.095058:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790100335.095063:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056140914432:0@lo:8: 00000004:00080000:3.0:1790100335.095086:0:10084:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790100335.095135:0:10084:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 186382795286ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790100335.095141:0:10084:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1790100335.095195:0:10085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10085:1877056140914688:0@lo:700: 00000100:00100000:1.0:1790100335.095225:0:10085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.095247:0:10085:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.095378:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140914688 00000100:00100000:0.0:1790100335.095384:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140914688 00000100:00100000:0.0:1790100335.095426:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100335.095434:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10085:x1877056140914688:12345-0@lo:700: 00000100:00100000:0.0:1790100335.095471:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8434:1877056140914816:0@lo:700: 00000100:00100000:0.0:1790100335.095499:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.095517:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.095535:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140914816 00000100:00100000:0.0:1790100335.095539:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140914816 00000100:00100000:0.0:1790100335.095563:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100335.095569:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8434:x1877056140914816:12345-0@lo:700: 00000020:01000000:0.0:1790100335.095814:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1790100335.095835:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790100335.095843:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.095866:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100335.095876:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790100335.095878:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926187007800 from 39 10000000:01000000:0.0:1790100335.095881:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790100335.095903:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.095911:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.095920:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100335.095931:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140914944:0@lo:101: 00000100:00100000:0.0:1790100335.095959:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.095991:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d10d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.096005:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140914944 00000100:00100000:0.0:1790100335.096009:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140914944 00000100:00100000:0.0:1790100335.096210:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790100335.096220:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140914944:12345-0@lo:101: 00010000:00010000:0.0:1790100335.096228:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100335.096240:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286b10 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.096259:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.096269:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.096277:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e58000, rc 0) 00000100:00100000:0.0:1790100335.096309:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140914944:12345-0@lo:101: Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.096315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790100335.096388:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140914944:0@lo:101: 00010000:00010000:0.0:1790100335.096401:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100335.096409:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100335.096464:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915072:0@lo:501: 00000100:00100000:0.0:1790100335.096488:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.096502:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d10d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.096520:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140915072 00000100:00100000:0.0:1790100335.096528:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140915072 00000100:00100000:0.0:1790100335.096551:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790100335.096557:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140915072:12345-0@lo:501: 00000100:00100000:0.0:1790100335.096656:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140915072:12345-0@lo:501: Request processed in 98us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.096663:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1790100335.096889:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100335.096931:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915072:0@lo:501: 00000100:00100000:2.0:1790100335.096958:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915200:0@lo:503: 00000100:00100000:2.0:1790100335.097008:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.097391:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a62b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.097941:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140915200 00000100:00100000:0.0:1790100335.097947:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140915200 00000100:00100000:0.0:1790100335.097980:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790100335.097988:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140915200:12345-0@lo:503: 00000100:00100000:0.0:1790100335.098098:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140915200:12345-0@lo:503: Request processed in 110us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.098105:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790100335.098162:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915200:0@lo:503: 00000100:00100000:0.0:1790100335.098368:0:10086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10086:1877056140915328:0@lo:502: 00000100:00100000:0.0:1790100335.098404:0:10086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.098423:0:10086:0:(client.c:2716:ptlrpc_set_wait()) set ffff92618420cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.098588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140915328 00000100:00100000:2.0:1790100335.098593:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140915328 00000100:00100000:2.0:1790100335.098622:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790100335.098629:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:10086:x1877056140915328:12345-0@lo:502: 00000100:00100000:2.0:1790100335.098696:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:10086:x1877056140915328:12345-0@lo:502: Request processed in 67us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.098703:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790100335.098718:0:10086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10086:1877056140915328:0@lo:502: 00000100:00100000:1.0:1790100335.098758:0:10086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10086:1877056140915456:0@lo:502: 00000100:00100000:1.0:1790100335.098795:0:10086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.098845:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140915456 00000100:00100000:2.0:1790100335.098860:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140915456 00000100:00100000:2.0:1790100335.098883:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790100335.098890:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:10086:x1877056140915456:12345-0@lo:502: 00000100:00100000:1.0:1790100335.098891:0:10086:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd180 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.099327:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:10086:x1877056140915456:12345-0@lo:502: Request processed in 436us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.099334:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790100335.099426:0:10086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10086:1877056140915456:0@lo:502: 00000040:00080000:1.0:1790100335.099472:0:10086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000001:00100000:1.0:1790100335.099606:0:6492:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:01000000:3.0:1790100335.100178:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1790100335.100200:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790100335.100210:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.100219:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100335.100228:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790100335.100230:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926187007800 from 6 10000000:01000000:3.0:1790100335.100233:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790100335.100268:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.100276:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.100285:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.100299:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915584:0@lo:101: 00000100:00100000:3.0:1790100335.100371:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.100399:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.100741:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140915584 00000100:00100000:1.0:1790100335.100747:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140915584 00000100:00100000:1.0:1790100335.100784:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790100335.100791:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140915584:12345-0@lo:101: 00010000:00010000:1.0:1790100335.100802:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100335.100812:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926189916800/0xc87a4f2298286b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286b1e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.100835:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926189916800/0xc87a4f2298286b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286b1e expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.100856:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926189916800/0xc87a4f2298286b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b1e expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.100864:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926189916800, rc 0) 00000100:00100000:1.0:1790100335.100908:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140915584:12345-0@lo:101: Request processed in 117us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.100914:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 40000000:02000000:0.0:1790100335.100987:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1790100335.101119:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915584:0@lo:101: 00010000:00010000:3.0:1790100335.101133:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.101142:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.101190:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915712:0@lo:256: 00000100:00100000:3.0:1790100335.101221:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.101240:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.101357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140915712 00000100:00100000:1.0:1790100335.101362:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140915712 00000100:00100000:1.0:1790100335.101386:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790100335.101393:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140915712:12345-0@lo:256: 20000000:01000000:1.0:1790100335.101407:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790100335.101427:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790100335.101430:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1790100335.101512:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140915712:12345-0@lo:256: Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.101519:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790100335.102601:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915712:0@lo:256: 10000000:01000000:3.0:1790100335.102659:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790100335.102666:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.102675:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100335.102690:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790100335.102693:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1790100335.102695:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790100335.102718:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.102726:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.102734:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.102747:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915840:0@lo:101: 00000100:00100000:3.0:1790100335.102783:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.102816:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.102923:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140915840 00000100:00100000:1.0:1790100335.102929:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140915840 00000100:00100000:1.0:1790100335.102969:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790100335.102990:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140915840:12345-0@lo:101: 00010000:00010000:1.0:1790100335.102999:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100335.103034:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286b2c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.103055:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.103065:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.103073:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6e00, rc 0) 00000100:00100000:1.0:1790100335.103362:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140915840:12345-0@lo:101: Request processed in 373us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.103369:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000004:00080000:1.0:1790100335.103562:0:7441:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000001:00100000:1.0:1790100335.103591:0:7441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000100:00100000:3.0:1790100335.103655:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915840:0@lo:101: 00010000:00010000:3.0:1790100335.103668:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.103677:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.103733:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915968:0@lo:501: 00000100:00100000:3.0:1790100335.103760:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.103820:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.105720:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140915968 00000100:00100000:2.0:1790100335.105731:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140915968 00000100:00100000:2.0:1790100335.105789:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790100335.105805:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140915968:12345-0@lo:501: 00000100:00100000:3.0:1790100335.106015:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140915968:0@lo:501: 00000100:00100000:3.0:1790100335.106064:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140916096:0@lo:503: 00000100:00100000:3.0:1790100335.106118:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.106152:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.106202:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140916096 00000100:00100000:1.0:1790100335.106207:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140916096 00000100:00100000:1.0:1790100335.106240:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790100335.106248:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140916096:12345-0@lo:503: 00000100:00100000:2.0:1790100335.106326:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140915968:12345-0@lo:501: Request processed in 168us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.106333:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140916096:12345-0@lo:503: Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.106335:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790100335.106359:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790100335.106433:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140916096:0@lo:503: 00000100:00100000:3.0:1790100335.108996:0:10087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10087:1877056140916224:0@lo:502: 00000100:00100000:3.0:1790100335.109253:0:10087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.109292:0:10087:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0300 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.109372:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8434:x1877056140914816:12345-0@lo:700: Request processed in 13801us (13869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.109383:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100335.109628:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140916224 00000100:00100000:0.0:1790100335.109635:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140916224 00000100:00100000:0.0:1790100335.109675:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790100335.109683:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:10087:x1877056140916224:12345-0@lo:502: 00000100:00100000:0.0:1790100335.109795:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:10087:x1877056140916224:12345-0@lo:502: Request processed in 101us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.109802:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790100335.110489:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8434:1877056140914816:0@lo:700: 40000000:02000000:3.0:1790100335.110500:0:8434:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1790100335.113538:0:10087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082131880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10087:1877056140916224:0@lo:502: 00000020:01000000:0.0:1790100335.114003:0:10087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100335.114011:0:10087:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790100335.114021:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100335.114269:0:10087:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790100335.114279:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790100335.114283:0:10087:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:0.0:1790100335.114306:0:10087:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790100335.114310:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100335.114325:0:10087:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9261b7973380) 00000020:00000080:0.0:1790100335.114784:0:10087:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1790100335.117182:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790100335.117399:0:10087:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790100335.117406:0:10087:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1790100335.117416:0:10087:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298286b41 00010000:00080000:1.0:1790100335.117453:0:10087:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261b777a800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790100335.117697:0:10087:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1790100335.118762:0:10087:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1790100335.118777:0:10087:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790100335.118957:0:10087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100335.119081:0:10087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100335.119208:0:10087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1790100335.119322:0:10087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1790100335.122075:0:10088:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100335.122082:0:10088:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:0.0:1790100335.123268:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1790100335.123290:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000100:00100000:2.0:1790100335.123457:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10085:x1877056140914688:12345-0@lo:700: Request processed in 28019us (28226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.123481:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790100335.123489:0:10085:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c56d80 x1877056140914688/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790100351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100335.123507:0:10085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10085:1877056140914688:0@lo:700: 00000020:00000080:0.0:1790100335.127074:0:10087:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790100335.127089:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100335.127131:0:10087:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790100335.127154:0:10087:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298286b48 00000100:00080000:0.0:1790100335.127163:0:10087:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100335.127173:0:10087:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9261b777a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100335.127205:0:10087:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083285c00 x1877056140916352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100335.127234:0:10087:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790100335.127309:0:10087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100335.127313:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100335.127327:0:10087:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790100335.127331:0:10087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100335.127334:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100335.127336:0:10087:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000100:00100000:3.0:1790100335.127511:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056140916352:0@lo:8: 00000100:00100000:3.0:1790100335.127569:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1790100335.127622:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790100335.127625:0:10087:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790100335.127651:0:10087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10087:1877056140916480:0@lo:502: 00000100:00100000:2.0:1790100335.127653:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140916352 00000100:00100000:2.0:1790100335.127661:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140916352 00000100:00100000:2.0:1790100335.127699:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100335.127704:0:10087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.127711:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1877056140916352:12345-0@lo:8: 00000100:00100000:0.0:1790100335.127729:0:10087:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5b39a80 going to sleep for 11 seconds 00010000:00080000:2.0:1790100335.127749:0:8425:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1790100335.127773:0:8425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298286b4f 00002000:00100000:2.0:1790100335.127784:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff926083b44800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790100335.127788:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790100335.127790:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790100335.127881:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790100335.127903:0:8425:0:(import.c:65:import_set_state_nolock()) ffff926083b42800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100335.127958:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1877056140916352:12345-0@lo:8: Request processed in 248us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.127966:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790100335.128052:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083285c00 x1877056140916352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100335.128062:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100335.128070:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790100335.128076:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790100335.128080:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790100335.128083:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b777a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790100335.128098:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790100335.128102:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056140916352:0@lo:8: 00000004:00080000:1.0:1790100335.128245:0:10088:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790100335.128294:0:10088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 186415953523ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790100335.128301:0:10088:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1790100335.130171:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140916480 00000100:00100000:3.0:1790100335.130184:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140916480 00000100:00100000:3.0:1790100335.130244:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790100335.130254:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:10087:x1877056140916480:12345-0@lo:502: 00000100:00100000:3.0:1790100335.130473:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:10087:x1877056140916480:12345-0@lo:502: Request processed in 218us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100335.130481:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1790100335.130499:0:10087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10087:1877056140916480:0@lo:502: 00000020:01000000:1.0:1790100335.130537:0:10087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100335.130543:0:10087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100335.130545:0:10087:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790100335.130549:0:10087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1790100335.130992:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1790100335.131021:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790100335.131096:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.131107:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100335.131116:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790100335.131125:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9261b2304d40 from 1 10000000:01000000:3.0:1790100335.131128:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790100335.131156:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.131163:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.131171:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.131188:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140916608:0@lo:101: 00000100:00100000:3.0:1790100335.131225:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.131432:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.132499:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140916608 00000100:00100000:1.0:1790100335.132514:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140916608 00000100:00100000:1.0:1790100335.132562:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790100335.132571:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140916608:12345-0@lo:101: 00010000:00010000:1.0:1790100335.132582:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100335.132596:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286b56 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.132620:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.132631:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100335.132639:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7800, rc 0) 00000100:00100000:1.0:1790100335.132711:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140916608:12345-0@lo:101: Request processed in 130us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.132719:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790100335.133130:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140916608:0@lo:101: 00010000:00010000:3.0:1790100335.133147:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100335.133158:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100335.133220:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140916736:0@lo:501: 00000100:00100000:3.0:1790100335.133251:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.133278:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.133588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140916736 00000100:00100000:1.0:1790100335.133594:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140916736 00000100:00100000:1.0:1790100335.133677:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1790100335.133687:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140916736:12345-0@lo:501: 00000100:00100000:1.0:1790100335.133793:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140916736:12345-0@lo:501: Request processed in 108us (541us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100335.133810:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790100335.134691:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140916736:0@lo:501: 10000000:01000000:2.0:1790100335.134731:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790100335.134740:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100335.134750:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790100335.135507:0:10085:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790100335.135525:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140916864:0@lo:13: 00000100:00100000:1.0:1790100335.135551:0:10085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10085:1877056140916992:0@lo:7: 00000100:00100000:3.0:1790100335.135581:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100335.135589:0:10085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.135647:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140916864 00000100:00100000:3.0:1790100335.135652:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140916864 00000100:00100000:3.0:1790100335.135706:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790100335.135723:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140916864:12345-0@lo:13: 00000100:00100000:1.0:1790100335.135889:0:10085:0:(client.c:2716:ptlrpc_set_wait()) set ffff92618420c840 going to sleep for 11 seconds 00000004:00080000:2.0:1790100335.136601:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00000024:3.0:1790100335.136675:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923951616 avail 3692429312 00000100:00100000:2.0:1790100335.136682:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140917120:0@lo:13: 00000100:00100000:2.0:1790100335.136727:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790100335.136769:0:10089:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790100335.136799:0:10089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10089:1877056140917248:0@lo:7: 00000100:00100000:2.0:1790100335.136823:0:10089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.136858:0:10089:0:(client.c:2716:ptlrpc_set_wait()) set ffff926189d3f180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.136880:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140916992 00000100:00100000:1.0:1790100335.136887:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140916992 00000100:00100000:3.0:1790100335.136919:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1877056140916864:12345-0@lo:13: Request processed in 1014us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.136922:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140917248 00000100:00100000:1.0:1790100335.136927:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140917248 00000100:00100000:3.0:1790100335.136932:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790100335.136954:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140917120 00000100:00100000:3.0:1790100335.136959:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140917120 00000100:00100000:1.0:1790100335.136965:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100335.136976:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10085:x1877056140916992:12345-0@lo:7: 00000100:00100000:3.0:1790100335.136983:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100335.136992:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1877056140917120:12345-0@lo:13: 00002000:00000024:3.0:1790100335.137017:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923951616 avail 3692429312 00010000:00080000:2.0:1790100335.137142:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c2a00 x1877056140917120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100335.137159:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140917120:0@lo:13: 00000100:00100000:3.0:1790100335.137175:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1877056140917120:12345-0@lo:13: Request processed in 81us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100335.137183:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1790100335.137219:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c197d880 x1877056140916864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100335.137233:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140916864:0@lo:13: 00000100:00080000:2.0:1790100335.138954:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1790100335.145042:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1790100335.145050:0:8425:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790100335.145141:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10085:x1877056140916992:12345-0@lo:7: Request processed in 8164us (9550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.145153:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100335.145182:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100335.145192:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10089:x1877056140917248:12345-0@lo:7: 00010000:00080000:0.0:1790100335.145399:0:10085:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63ff480 x1877056140916992/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790100351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100335.145415:0:10085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10085:1877056140916992:0@lo:7: 00000004:00080000:0.0:1790100335.145430:0:10085:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790100335.145468:0:10085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10085:1877056140917376:0@lo:5: 00000100:00100000:0.0:1790100335.145512:0:10085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100335.145544:0:10085:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5b39540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.145607:0:8427:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790100335.145617:0:8427:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790100335.146002:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140917376 00000100:00100000:3.0:1790100335.146010:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140917376 00000100:00100000:2.0:1790100335.146125:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100335.146135:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10085:x1877056140917376:12345-0@lo:5: 00002000:00080000:2.0:1790100335.146155:0:10090:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1790100335.146202:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10085:x1877056140917376:12345-0@lo:5: Request processed in 68us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100335.146210:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790100335.146222:0:10085:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083285c00 x1877056140917376/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100335.146234:0:10085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10085:1877056140917376:0@lo:5: 00000004:00080000:3.0:1790100335.146246:0:10085:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790100335.146286:0:10085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10085:1877056140917504:0@lo:5: 00000100:00100000:3.0:1790100335.146318:0:10085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.146375:0:10085:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.146420:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140917504 00000100:00100000:2.0:1790100335.146425:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140917504 00000100:00100000:2.0:1790100335.146460:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100335.146469:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10085:x1877056140917504:12345-0@lo:5: 00002000:00080000:2.0:1790100335.146490:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00002000:00080000:0.0:1790100335.151949:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1790100335.151957:0:8425:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790100335.152053:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10089:x1877056140917248:12345-0@lo:7: Request processed in 6860us (15225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.152070:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790100335.154887:0:10089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c1f80 x1877056140917248/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790100351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100335.154907:0:10089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10089:1877056140917248:0@lo:7: 00000004:00080000:3.0:1790100335.154924:0:10089:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790100335.154960:0:10089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082132a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10089:1877056140917632:0@lo:5: 00000100:00100000:3.0:1790100335.155017:0:10089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.155064:0:10089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1790100335.155336:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10085:x1877056140917504:12345-0@lo:5: Request processed in 8867us (9016us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790100335.155362:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100335.155383:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140917632 00000100:00100000:2.0:1790100335.155388:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140917632 00000100:00100000:2.0:1790100335.155426:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790100335.155433:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10089:x1877056140917632:12345-0@lo:5: 00002000:00080000:2.0:1790100335.155462:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790100335.155465:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:3.0:1790100335.157166:0:10085:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926082133100 x1877056140917504/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100335.157183:0:10085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10085:1877056140917504:0@lo:5: 00000004:00080000:3.0:1790100335.157196:0:10085:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790100335.157246:0:10085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10085:1877056140917760:0@lo:900: 00000100:00100000:3.0:1790100335.157290:0:10085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.157324:0:10085:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100335.157440:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140917760 00000100:00100000:1.0:1790100335.157446:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140917760 00000100:00100000:1.0:1790100335.157485:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100335.157493:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10085:x1877056140917760:12345-0@lo:900: 00000100:00100000:1.0:1790100335.157554:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10085:x1877056140917760:12345-0@lo:900: Request processed in 62us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100335.157560:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100335.157589:0:10085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10085:1877056140917760:0@lo:900: 00000001:00080000:0.0:1790100335.159068:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1790100335.159078:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1790100335.159086:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790100335.159280:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10089:x1877056140917632:12345-0@lo:5: Request processed in 3846us (4262us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790100335.159289:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1790100335.159471:0:10089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926082132a00 x1877056140917632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100335.159481:0:10089:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790100335.159486:0:10089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082132a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10089:1877056140917632:0@lo:5: 00000004:00080000:2.0:1790100335.159498:0:10089:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790100335.159548:0:10089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10089:1877056140917888:0@lo:700: 00000100:00100000:2.0:1790100335.159580:0:10089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100335.159644:0:10089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261933bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.159677:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140917888 00000100:00100000:0.0:1790100335.159682:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140917888 00000100:00100000:0.0:1790100335.159748:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100335.159756:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10089:x1877056140917888:12345-0@lo:700: 00000100:00100000:0.0:1790100335.168070:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10089:x1877056140917888:12345-0@lo:700: Request processed in 8306us (8481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100335.168084:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790100335.168194:0:10089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c2a00 x1877056140917888/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790100351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100335.168209:0:10089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10089:1877056140917888:0@lo:700: 00000004:02000040:3.0:1790100335.169865:0:10089:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1790100335.174209:0:10089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10089:1877056140918016:0@lo:5: 00000100:00100000:3.0:1790100335.174271:0:10089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100335.174470:0:10089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100335.174576:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140918016 00000100:00100000:0.0:1790100335.174584:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140918016 00000100:00100000:0.0:1790100335.174635:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100335.174644:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10089:x1877056140918016:12345-0@lo:5: 00002000:00080000:0.0:1790100335.180279:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1790100335.180298:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1790100335.181784:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10089:x1877056140918016:12345-0@lo:5: Request processed in 7136us (7507us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790100335.181795:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1790100335.181908:0:10089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb1c00 x1877056140918016/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100335.181923:0:10089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10089:1877056140918016:0@lo:5: 00000004:00080000:3.0:1790100335.181935:0:10089:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1790100335.433932:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100336.456914:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100336.628976:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100336.629113:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127241856 00000100:00100000:3.0:1790100336.629122:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127241856 00000100:00100000:3.0:1790100336.629199:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790100336.629210:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6265:x1877056127241856:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1790100336.629244:0:9338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:2.0:1790100336.629412:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100336.629472:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6265:x1877056127241856:12345-192.168.203.13@tcp:41: Request processed in 264us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100336.629480:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790100336.638135:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100336.638288:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127241984 00000100:00100000:2.0:1790100336.638298:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127241984 00000100:00100000:2.0:1790100336.638397:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1790100336.638407:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:6265:x1877056127241984:12345-192.168.203.13@tcp:41: 00000004:00000024:2.0:1790100336.638444:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100336.638509:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:6265:x1877056127241984:12345-192.168.203.13@tcp:41: Request processed in 103us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100336.638516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00080000:1.0:1790100336.639139:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100336.650432:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100336.650498:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127242112 00000100:00100000:0.0:1790100336.650507:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127242112 00000100:00100000:0.0:1790100336.650577:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790100336.650586:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6265:x1877056127242112:12345-192.168.203.13@tcp:13: 00002000:00000024:0.0:1790100336.650630:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100336.650692:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e84eb833-b466-4273-a7db-c12bb35adfb4+6:6265:x1877056127242112:12345-192.168.203.13@tcp:13: Request processed in 107us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100336.650700:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00080000:1.0:1790100336.651470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100336.654961:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100336.655059:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127242240 00000100:00100000:3.0:1790100336.655069:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127242240 00000100:00100000:3.0:1790100336.655134:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1790100336.655144:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e84eb833-b466-4273-a7db-c12bb35adfb4+5:6265:x1877056127242240:12345-192.168.203.13@tcp:13: 00002000:00000024:3.0:1790100336.655169:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100336.655240:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e84eb833-b466-4273-a7db-c12bb35adfb4+5:6265:x1877056127242240:12345-192.168.203.13@tcp:13: Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100336.655247:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00080000:1.0:1790100336.655368:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790100337.482039:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100338.120478:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140918144:0@lo:13: 00000100:00100000:3.0:1790100338.120545:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100338.120623:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140918144 00000100:00100000:3.0:1790100338.120630:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140918144 00000100:00100000:3.0:1790100338.120684:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100338.120694:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140918144:12345-0@lo:13: 00002000:00000024:3.0:1790100338.120721:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100338.120767:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140918144:12345-0@lo:13: Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100338.120783:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790100338.120804:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790100338.120844:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb3480 x1877056140918144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100338.120861:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140918144:0@lo:13: 00000100:00100000:0.0:1790100338.121040:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140918272:0@lo:13: 00000100:00100000:2.0:1790100338.121620:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100338.124388:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140918272 00000100:00100000:0.0:1790100338.124399:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140918272 00000100:00100000:0.0:1790100338.124458:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790100338.124467:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140918272:12345-0@lo:13: 00002000:00000024:0.0:1790100338.124489:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100338.124564:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140918272:12345-0@lo:13: Request processed in 97us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100338.124571:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1790100338.124577:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790100338.124621:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083284380 x1877056140918272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100338.124641:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140918272:0@lo:13: 00000001:02000400:3.0:1790100338.486567:0:10175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1790100338.509166:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100338.636317:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140918400:0@lo:41: 00000100:00100000:1.0:1790100338.636719:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100338.640189:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140918400 00000100:00100000:2.0:1790100338.640204:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140918400 00000100:00100000:2.0:1790100338.640265:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790100338.640274:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140918400:12345-0@lo:41: 00000004:00000024:2.0:1790100338.640310:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1790100338.640416:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140918400:12345-0@lo:41: Request processed in 143us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100338.640424:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790100338.640465:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140918400:0@lo:41: 00010000:00010000:0.0:1790100339.530321:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100339.657670:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100339.657693:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140918528:0@lo:41: 00000100:00100000:2.0:1790100339.657758:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100339.657862:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140918528 00000100:00100000:1.0:1790100339.657870:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140918528 00000100:00100000:1.0:1790100339.657935:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790100339.657944:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140918528:12345-0@lo:41: 00000004:00000024:1.0:1790100339.657985:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790100339.658045:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140918528:12345-0@lo:41: Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100339.658053:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100339.658095:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140918528:0@lo:41: 00000100:00100000:3.0:1790100340.055819:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100340.055858:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100340.055889:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100340.055913:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127242752 00000100:00100000:3.0:1790100340.055921:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127242752 00000100:00100000:3.0:1790100340.055978:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1790100340.055998:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127242752:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1790100340.056059:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127242752:12345-192.168.203.13@tcp:400: Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.056067:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:3.0:1790100340.056087:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100340.056170:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127242496 00000100:00100000:2.0:1790100340.056176:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127242496 00000100:00080000:3.0:1790100340.056194:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100340.056217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1790100340.056228:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127242496:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1790100340.056277:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127242496:12345-192.168.203.13@tcp:400: Request processed in 52us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.056285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1790100340.056461:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127242368 00000100:00100000:2.0:1790100340.056466:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127242368 00000100:00100000:2.0:1790100340.056501:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:2.0:1790100340.056509:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2422:x1877056127242368:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1790100340.056557:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2422:x1877056127242368:12345-192.168.203.13@tcp:400: Request processed in 49us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.056564:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1790100340.062912:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100340.062955:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100340.062984:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127242880 00000100:00100000:1.0:1790100340.062993:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127242880 00000100:00100000:1.0:1790100340.063049:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1790100340.063060:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127242880:12345-192.168.203.13@tcp:400: 00000100:00100000:1.0:1790100340.063126:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127242880:12345-192.168.203.13@tcp:400: Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100340.063134:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00080000:1.0:1790100340.063155:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100340.063456:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127242624 00000100:00100000:2.0:1790100340.063467:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127242624 00000100:00100000:2.0:1790100340.063504:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1790100340.063511:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127242624:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1790100340.063546:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127242624:12345-192.168.203.13@tcp:400: Request processed in 35us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.063553:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00080000:2.0:1790100340.063570:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100340.168646:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100340.168668:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140918656:0@lo:13: 00000100:00100000:0.0:1790100340.168737:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100340.168912:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140918656 00000100:00100000:3.0:1790100340.168919:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140918656 00000100:00100000:3.0:1790100340.168984:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100340.168993:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140918656:12345-0@lo:13: 00002000:00000024:3.0:1790100340.169021:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100340.169069:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140918656:12345-0@lo:13: Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.169090:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790100340.169128:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb1180 x1877056140918656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100340.169147:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140918656:0@lo:13: 00000100:00080000:2.0:1790100340.169232:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100340.170128:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140918784:0@lo:400: 00000100:00100000:2.0:1790100340.170176:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.170210:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140919296:0@lo:400: 00000100:00100000:2.0:1790100340.170237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.170257:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140919808:0@lo:400: 00000100:00100000:2.0:1790100340.170282:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.170304:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790100340.170311:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140918912:0@lo:400: 00000100:00100000:2.0:1790100340.170336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.170559:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140919424:0@lo:400: 00000100:00100000:2.0:1790100340.170586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.170604:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140919936:0@lo:400: 00000100:00100000:2.0:1790100340.170624:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.170656:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140919296 00000100:00100000:2.0:1790100340.170661:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140919296 00000100:00100000:2.0:1790100340.170891:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790100340.170899:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140919296:12345-0@lo:400: 00000100:00100000:2.0:1790100340.170944:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140919296:12345-0@lo:400: Request processed in 46us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.170958:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790100340.170980:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140919808 00000100:00100000:2.0:1790100340.170983:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140919808 00000100:00100000:2.0:1790100340.171011:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790100340.171017:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140919808:12345-0@lo:400: 00000100:00100000:2.0:1790100340.171048:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140919808:12345-0@lo:400: Request processed in 31us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.171054:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790100340.171070:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140918912 00000100:00100000:2.0:1790100340.171074:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140918912 00000100:00100000:2.0:1790100340.171094:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140919424 00000100:00100000:2.0:1790100340.171097:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140919424 00000100:00100000:2.0:1790100340.171109:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140919936 00000100:00100000:2.0:1790100340.171112:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140919936 00000100:00100000:2.0:1790100340.171125:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790100340.171131:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140918912:12345-0@lo:400: 00000100:00100000:2.0:1790100340.171161:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140918912:12345-0@lo:400: Request processed in 30us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.171167:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790100340.171178:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790100340.171184:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140919424:12345-0@lo:400: 00000100:00100000:2.0:1790100340.171207:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140919424:12345-0@lo:400: Request processed in 24us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.171213:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790100340.171223:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100340.171229:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140919936:12345-0@lo:400: 00000100:00100000:2.0:1790100340.171253:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140919936:12345-0@lo:400: Request processed in 24us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.171264:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100340.171295:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140919168:0@lo:400: 00000100:00100000:2.0:1790100340.171321:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.171358:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140919680:0@lo:400: 00000100:00100000:2.0:1790100340.171389:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.171408:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140920192:0@lo:400: 00000100:00100000:2.0:1790100340.171432:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.171450:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790100340.171457:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140919040:0@lo:400: 00000100:00100000:2.0:1790100340.171477:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.171492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056140919552:0@lo:400: 00000100:00100000:2.0:1790100340.171511:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.171526:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140920064:0@lo:400: 00000100:00100000:2.0:1790100340.171554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.171577:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140919680 00000100:00100000:2.0:1790100340.171581:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140919680 00000100:00100000:2.0:1790100340.171601:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140920192 00000100:00100000:2.0:1790100340.171603:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140920192 00000100:00100000:2.0:1790100340.171616:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100340.171622:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140919680:12345-0@lo:400: 00000100:00100000:2.0:1790100340.171664:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140919680:12345-0@lo:400: Request processed in 41us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.171670:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100340.171680:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100340.171686:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140920192:12345-0@lo:400: 00000100:00100000:2.0:1790100340.171981:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140920192:12345-0@lo:400: Request processed in 294us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.171988:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100340.172003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140919168 00000100:00100000:2.0:1790100340.172007:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140919168 00000100:00100000:2.0:1790100340.172069:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140919552 00000100:00100000:2.0:1790100340.172073:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140919552 00000100:00100000:0.0:1790100340.172155:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140918784 00000100:00100000:0.0:1790100340.172159:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140918784 00000100:00100000:0.0:1790100340.172187:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790100340.172193:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140918784:12345-0@lo:400: 00000100:00100000:0.0:1790100340.172233:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140918784:12345-0@lo:400: Request processed in 40us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.172239:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790100340.172417:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100340.172428:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140920320:0@lo:13: 00000100:00100000:0.0:1790100340.172454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100340.172525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140920064 00000100:00100000:3.0:1790100340.172529:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140920064 00000100:00100000:3.0:1790100340.172552:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790100340.172559:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140919168:12345-0@lo:400: 00000100:00100000:3.0:1790100340.172593:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140919168:12345-0@lo:400: Request processed in 34us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.172598:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790100340.172608:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790100340.172613:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056140919552:12345-0@lo:400: 00000100:00100000:3.0:1790100340.172636:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056140919552:12345-0@lo:400: Request processed in 23us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.172641:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790100340.172652:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100340.172657:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140920064:12345-0@lo:400: 00000100:00100000:3.0:1790100340.172677:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140920064:12345-0@lo:400: Request processed in 21us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.172682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100340.172700:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140920320 00000100:00100000:3.0:1790100340.172715:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140920320 00000100:00100000:3.0:1790100340.172737:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790100340.172743:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140920320:12345-0@lo:13: 00002000:00000024:3.0:1790100340.172765:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100340.172800:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140920320:12345-0@lo:13: Request processed in 57us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.172806:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1790100340.172850:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083285c00 x1877056140920320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100340.172860:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790100340.172878:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140920320:0@lo:13: 00000100:00080000:2.0:1790100340.173048:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100340.173052:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100340.173054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100340.173056:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790100340.173088:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c3b80 x1877056140919552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100340.173098:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056140919552:0@lo:400: 00010000:00080000:2.0:1790100340.173108:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c0a80 x1877056140920064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100340.173116:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140920064:0@lo:400: 00000100:00100000:2.0:1790100340.173126:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140919168:0@lo:400: 00010000:00080000:2.0:1790100340.173135:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c2300 x1877056140919680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100340.173142:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140919680:0@lo:400: 00010000:00080000:2.0:1790100340.173152:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c2d80 x1877056140920192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100340.173160:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140920192:0@lo:400: 00000100:00100000:2.0:1790100340.173191:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140918912:0@lo:400: 00000100:00100000:2.0:1790100340.173212:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140919424:0@lo:400: 00000100:00100000:2.0:1790100340.173222:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140919936:0@lo:400: 00000100:00100000:2.0:1790100340.173231:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140918784:0@lo:400: 00000100:00100000:2.0:1790100340.173240:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140919296:0@lo:400: 00010000:00080000:2.0:1790100340.173250:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c0380 x1877056140919808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100340.173258:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140919808:0@lo:400: 00000100:00100000:0.0:1790100340.174398:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140919040 00000100:00100000:0.0:1790100340.174407:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140919040 00000100:00100000:0.0:1790100340.174444:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790100340.174453:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140919040:12345-0@lo:400: 00000100:00100000:0.0:1790100340.174525:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140919040:12345-0@lo:400: Request processed in 72us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.174531:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790100340.174664:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140919040:0@lo:400: 00010000:00010000:0.0:1790100340.553569:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790100340.683734:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000001:00080000:2.0:1790100340.686152:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000020:00000080:2.0:1790100340.960857:0:10322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe3f0dc00 20000000:00000080:2.0:1790100340.960874:0:10322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff926083b76400 uarg=0000000000000000 20000000:01000000:2.0:1790100340.960914:0:10322:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1790100340.960916:0:10322:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1790100340.960919:0:10322:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1790100340.960923:0:10322:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1790100340.960928:0:10322:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1790100340.960975:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790100340.960977:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790100340.961299:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1790100340.961711:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1790100340.961738:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1790100340.961748:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1790100340.961754:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790100340.961755:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790100340.962141:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1790100340.962543:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1790100340.962568:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1790100340.962585:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1790100340.962595:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790100340.962597:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790100340.962990:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1790100340.963680:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1790100340.963706:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1790100340.963723:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1790100340.963733:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790100340.963735:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790100340.965049:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1790100340.965262:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1790100340.965288:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1790100340.965304:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1790100340.965320:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790100340.965322:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790100340.966091:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1790100340.966196:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1790100340.966217:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1790100340.966233:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:3.0:1790100340.966246:0:10322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790100340.966264:0:10322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966280:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966288:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966319:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966327:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966534:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286aae expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966542:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286abc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966549:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286aca expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966556:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966562:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966569:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966577:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966584:0:10322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966628:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966643:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 23 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.966656:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920448:0@lo:104: 00000100:00100000:3.0:1790100340.966713:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.966755:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140920448 00000100:00100000:2.0:1790100340.966762:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140920448 00010000:00010000:3.0:1790100340.966768:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966776:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 23 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.966795:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920576:0@lo:104: 00000100:00100000:3.0:1790100340.966828:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.966968:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140920576 00000100:00100000:2.0:1790100340.966972:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140920576 00010000:00010000:3.0:1790100340.966980:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.966988:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 23 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.966997:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920704:0@lo:104: 00000100:00100000:2.0:1790100340.967000:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790100340.967008:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+4:10322:x1877056140920448:12345-0@lo:104: 00000100:00100000:3.0:1790100340.967018:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100340.967030:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.967033:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.967041:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 23 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.967058:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920832:0@lo:104: 00010000:00010000:2.0:1790100340.967074:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100340.967078:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.967080:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+4:10322:x1877056140920448:12345-0@lo:104: Request processed in 73us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.967087:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1790100340.967093:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286aca expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.967100:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286aca expref: 23 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.967104:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790100340.967108:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920960:0@lo:104: 00000100:00100000:2.0:1790100340.967112:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140920704 00000100:00100000:2.0:1790100340.967115:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140920704 00000100:00100000:3.0:1790100340.967124:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.967126:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140920832 00000100:00100000:2.0:1790100340.967128:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140920832 00000100:00100000:2.0:1790100340.967137:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140920960 00010000:00010000:3.0:1790100340.967139:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286abc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.967139:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140920960 00010000:00010000:3.0:1790100340.967147:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286abc expref: 23 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.967148:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790100340.967155:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921088:0@lo:104: 00000100:00100000:2.0:1790100340.967166:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+6:10322:x1877056140920576:12345-0@lo:104: 00000100:00100000:3.0:1790100340.967173:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100340.967173:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.967188:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286aae expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.967196:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286aae expref: 23 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.967204:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921216:0@lo:104: 00010000:00010000:2.0:1790100340.967207:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790100340.967212:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+6:10322:x1877056140920576:12345-0@lo:104: Request processed in 59us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.967218:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790100340.967229:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140921088 00000100:00100000:3.0:1790100340.967230:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.967232:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140921088 00000100:00100000:2.0:1790100340.967241:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140921216 00000100:00100000:2.0:1790100340.967244:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140921216 00010000:00010000:3.0:1790100340.967250:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.967253:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100340.967269:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+7:10322:x1877056140920704:12345-0@lo:104: 00010000:00010000:3.0:1790100340.967270:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 9 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.967276:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.967279:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921344:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100340.967314:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100340.967324:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+7:10322:x1877056140920832:12345-0@lo:104: 00010000:00010000:0.0:1790100340.967332:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.967429:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.967438:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 9 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.967447:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921472:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100340.968271:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790100340.968279:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+7:10322:x1877056140920704:12345-0@lo:104: Request processed in 1020us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.968287:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100340.968304:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790100340.968312:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+6:10322:x1877056140920960:12345-0@lo:104: 00010000:00010000:2.0:1790100340.968321:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.968363:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790100340.968368:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+6:10322:x1877056140920960:12345-0@lo:104: Request processed in 58us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.968374:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1790100340.968542:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1790100340.968630:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+5:10322:x1877056140920832:12345-0@lo:104: Request processed in 1227us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.968648:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1790100340.968651:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.968660:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+5:10322:x1877056140921088:12345-0@lo:104: 00010000:00010000:3.0:1790100340.968661:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 23 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.968671:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921600:0@lo:104: 00000100:00100000:3.0:1790100340.968697:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100340.968724:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.968729:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.968732:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 23 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.968740:0:10322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921728:0@lo:104: 00010000:00010000:2.0:1790100340.968757:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1790100340.968758:0:10322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.968762:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+5:10322:x1877056140921088:12345-0@lo:104: Request processed in 103us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.968773:0:10322:0:(client.c:2716:ptlrpc_set_wait()) set ffff92619448de40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100340.968789:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790100340.968802:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920448:0@lo:104: 00000100:00100000:3.0:1790100340.968821:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920576:0@lo:104: 00000100:00100000:3.0:1790100340.968827:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920704:0@lo:104: 00000100:00100000:3.0:1790100340.968834:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920832:0@lo:104: 00000100:00100000:0.0:1790100340.968839:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140921600 00000100:00100000:3.0:1790100340.968840:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140920960:0@lo:104: 00000100:00100000:0.0:1790100340.968842:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140921600 00000100:00100000:3.0:1790100340.968846:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921088:0@lo:104: 00000100:00100000:0.0:1790100340.968865:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140921728 00000100:00100000:0.0:1790100340.968868:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140921728 00000100:00100000:0.0:1790100340.968878:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790100340.968892:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+6:10322:x1877056140921216:12345-0@lo:104: 00010000:00010000:0.0:1790100340.968900:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.968934:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1790100340.968939:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+6:10322:x1877056140921216:12345-0@lo:104: Request processed in 56us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.968945:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790100340.968957:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790100340.968962:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+5:10322:x1877056140921600:12345-0@lo:104: 00010000:00010000:0.0:1790100340.968969:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.969005:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1790100340.969010:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+5:10322:x1877056140921600:12345-0@lo:104: Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.969016:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790100340.969039:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790100340.969044:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:10322:x1877056140921728:12345-0@lo:104: 00010000:00010000:0.0:1790100340.969051:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.969074:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1790100340.969079:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:10322:x1877056140921728:12345-0@lo:104: Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.969092:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100340.969128:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1790100340.969158:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1790100340.969164:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969170:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565dc00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100340.969175:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969183:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.969189:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.969195:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.969227:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969234:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100340.969251:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.969534:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921216:0@lo:104: 00010000:00010000:2.0:1790100340.969642:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298286b56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969653:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1790100340.969657:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969663:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261c2178800 already unused, calling callback (ffffffffc13ccc20) 00000100:00100000:3.0:1790100340.969666:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921600:0@lo:104: 10000000:00010000:2.0:1790100340.969666:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969684:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.969690:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.969695:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.969708:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969713:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100340.969727:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969733:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261c2178800/0xc87a4f2298286b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b33 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969742:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:3.0:1790100340.969747:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921728:0@lo:104: 00010000:00010000:2.0:1790100340.969750:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969756:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58800 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100340.969759:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969765:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.969771:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.969776:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.969789:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969795:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100340.969800:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969816:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286b17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969825:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790100340.969828:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969834:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189917400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100340.969837:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969855:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.969861:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.969865:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.969878:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969884:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100340.969890:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969895:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189917400/0xc87a4f2298286aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ad1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969904:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790100340.969907:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969912:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189917000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100340.969915:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969922:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.969929:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.969939:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.969951:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969956:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100340.969960:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969966:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189917000/0xc87a4f2298286ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286aed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969988:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790100340.969991:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.969996:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59600 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100340.969999:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970006:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.970011:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.970016:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.970028:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970034:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100340.970044:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970050:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59600/0xc87a4f2298286abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ac3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970059:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790100340.970062:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970068:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189917600 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100340.970070:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970077:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.970083:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.970088:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.970100:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970106:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100340.970109:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970114:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189917600/0xc87a4f2298286aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ab5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970122:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100340.970130:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970135:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59e00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100340.970137:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970143:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.970159:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.970164:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.970177:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970182:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100340.970187:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970192:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286a22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286a29 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970201:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100340.970204:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970209:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189917200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100340.970212:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970228:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100340.970234:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100340.970239:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100340.970252:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.970257:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790100340.970553:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140921856:0@lo:103: 00000100:00100000:3.0:1790100340.970598:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100340.970638:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140922368:0@lo:103: 00000100:00100000:3.0:1790100340.970658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100340.970679:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790100340.970684:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140922240:0@lo:103: 00000100:00100000:3.0:1790100340.970702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100340.970716:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140922752:0@lo:103: 00000100:00100000:3.0:1790100340.970733:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100340.970751:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100340.970757:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100340.970780:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140921856 00000100:00100000:0.0:1790100340.970787:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140921856 00010000:00010000:0.0:1790100340.970823:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 24 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100340.970840:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140922368 00000100:00100000:0.0:1790100340.970843:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140922368 00010000:00010000:0.0:1790100340.970854:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 25 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100340.970863:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140922240 00000100:00100000:0.0:1790100340.970866:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140922240 00010000:00010000:0.0:1790100340.970882:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286aca expref: 26 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100340.970893:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140922752 00000100:00100000:0.0:1790100340.970895:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140922752 00010000:00010000:0.0:1790100340.970906:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 27 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100340.970917:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100340.970924:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184257450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+27:3642:x1877056140921856:12345-0@lo:103: 00010000:00010000:0.0:1790100340.970934:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100340.970939:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 27 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.970949:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 27 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.970965:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7800/0xc87a4f2298286b5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286b56 expref: 27 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.970991:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100340.971029:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184257450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+26:3642:x1877056140921856:12345-0@lo:103: Request processed in 105us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.971036:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790100340.971057:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140921856:0@lo:103: 00000100:00100000:0.0:1790100340.971072:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100340.971079:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+25:3642:x1877056140922368:12345-0@lo:103: 00010000:00010000:0.0:1790100340.971086:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100340.971090:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 25 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.971098:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 25 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.971107:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59800/0xc87a4f2298286aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286ae6 expref: 25 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.971115:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100340.971311:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140922368:12345-0@lo:103: Request processed in 232us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.971317:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100340.971331:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790100340.971374:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+23:3642:x1877056140922240:12345-0@lo:103: 00010000:00010000:0.0:1790100340.971382:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.971558:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.971567:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189917200/0xc87a4f22982869f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982869ff expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.971580:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100340.971582:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100340.971584:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100340.971591:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100340.971600:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140922880:0@lo:103: 00000100:00100000:2.0:1790100340.971628:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.971649:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140921984:0@lo:103: 00000100:00100000:2.0:1790100340.971680:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.971691:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140922496:0@lo:103: 00000100:00100000:2.0:1790100340.971709:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.971719:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790100340.971732:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140922112:0@lo:103: 00000100:00100000:2.0:1790100340.971754:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.971763:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140922624:0@lo:103: 00000100:00100000:2.0:1790100340.971782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100340.971814:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140922880 00000100:00100000:2.0:1790100340.971818:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140922880 00010000:00010000:2.0:1790100340.971835:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 24 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.971847:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140921984 00000100:00100000:2.0:1790100340.971849:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140921984 00010000:00010000:2.0:1790100340.971858:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 25 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.971868:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140922496 00000100:00100000:2.0:1790100340.971870:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140922496 00010000:00010000:2.0:1790100340.971880:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286abc expref: 26 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.971888:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140922112 00000100:00100000:2.0:1790100340.971891:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140922112 00010000:00010000:2.0:1790100340.971900:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 27 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.971909:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140922624 00000100:00100000:2.0:1790100340.971912:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140922624 00010000:00010000:2.0:1790100340.971921:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286aae expref: 28 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.971932:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100340.971937:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+28:3642:x1877056140922752:12345-0@lo:103: 00010000:00010000:2.0:1790100340.971952:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.971957:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 28 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.971965:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 28 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.971975:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189917800/0xc87a4f2298286a29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286a22 expref: 28 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.971985:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100340.972008:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+27:3642:x1877056140922752:12345-0@lo:103: Request processed in 72us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.972014:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100340.972027:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790100340.972033:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+26:3641:x1877056140922880:12345-0@lo:103: 00010000:00010000:2.0:1790100340.972039:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.972042:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 26 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972047:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 26 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972053:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189916600/0xc87a4f22982869ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982869f8 expref: 26 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972059:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100340.972078:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+25:3641:x1877056140922880:12345-0@lo:103: Request processed in 46us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.972088:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790100340.972097:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790100340.972101:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140921984:12345-0@lo:103: 00010000:00010000:2.0:1790100340.972105:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.972108:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 24 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972114:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 24 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972123:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6e00/0xc87a4f2298286b33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286b2c expref: 24 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972131:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100340.972171:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+23:3643:x1877056140921984:12345-0@lo:103: Request processed in 70us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.972176:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790100340.972187:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790100340.972193:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+22:3643:x1877056140922496:12345-0@lo:103: 00010000:00010000:2.0:1790100340.972200:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.972203:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286abc expref: 22 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972210:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286abc expref: 22 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972219:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286abc expref: 22 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972236:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100340.972257:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+21:3643:x1877056140922496:12345-0@lo:103: Request processed in 65us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.972263:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790100340.972275:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100340.972280:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184254850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+20:3643:x1877056140922112:12345-0@lo:103: 00010000:00010000:2.0:1790100340.972287:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.972291:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 20 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972299:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 20 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972309:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286b10 expref: 20 pid: 6506 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972316:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100340.972355:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184254850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+19:3643:x1877056140922112:12345-0@lo:103: Request processed in 56us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.972362:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100340.972373:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100340.972380:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+18:3643:x1877056140922624:12345-0@lo:103: 00010000:00010000:0.0:1790100340.972479:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286aca expref: 18 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.972489:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286aca expref: 18 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.972505:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189916000/0xc87a4f2298286ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286aca expref: 18 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.972512:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100340.972692:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.972698:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286aae expref: 17 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972707:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286aae expref: 17 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972723:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180030000/0xc87a4f2298286ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286aae expref: 17 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.972732:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100340.972870:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140922368:0@lo:103: 00000100:00100000:3.0:1790100340.972886:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140922240:0@lo:103: 00000100:00100000:3.0:1790100340.972902:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140922752:0@lo:103: 00000100:00100000:3.0:1790100340.972937:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921344:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100340.973049:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+16:3642:x1877056140922240:12345-0@lo:103: Request processed in 1711us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.973056:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790100340.973558:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140922880:0@lo:103: 00000100:00100000:2.0:1790100340.975072:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+15:3643:x1877056140922624:12345-0@lo:103: Request processed in 2688us (3285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100340.975076:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100340.975084:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100340.975107:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127243008 00000100:00100000:2.0:1790100340.975114:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127243008 00000100:00100000:1.0:1790100340.975119:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:2.0:1790100340.975144:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 10 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.975175:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1790100340.975185:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127243008:12345-192.168.203.13@tcp:103: 00010000:00010000:2.0:1790100340.975195:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.975201:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 10 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975213:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 10 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975229:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261c2179400/0xc87a4f2298286a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfca expref: 10 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.975231:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127243136 00000100:00100000:3.0:1790100340.975235:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127243136 00010000:00010000:2.0:1790100340.975243:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100340.975243:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100340.975263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:3.0:1790100340.975275:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127243136:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1790100340.975285:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100340.975298:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565de00/0xc87a4f2298286b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e03a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.975314:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100340.975320:0:10322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1877056140921472:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100340.975327:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92619565de00/0xc87a4f2298286b6b lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e03a expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.975370:0:6506:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100340.975400:0:10322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.975475:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:2421:x1877056127243008:12345-192.168.203.13@tcp:103: Request processed in 291us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.975482:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1790100340.975505:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127243264 00000100:00100000:2.0:1790100340.975508:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127243264 00010000:00010000:2.0:1790100340.975520:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 11 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.975543:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1790100340.975550:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:2422:x1877056127243264:12345-192.168.203.13@tcp:103: 00010000:00010000:2.0:1790100340.975558:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100340.975562:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 11 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975572:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 11 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975583:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261c2178400/0xc87a4f2298286a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dfc3 expref: 11 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975593:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975600:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975612:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975619:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975626:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975643:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975649:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100340.975653:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975660:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975675:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92619565de00/0xc87a4f2298286b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e03a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975682:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565de00/0xc87a4f2298286b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e03a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.975704:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff92619565de00/0xc87a4f2298286b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e03a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100340.975716:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:6500:1877056140923008:192.168.203.13@tcp:105: 00010000:00010000:3.0:1790100340.975760:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565de00/0xc87a4f2298286b6b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e03a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100340.975772:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565de00, rc 0) 00000100:00100000:3.0:1790100340.975797:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127243136:12345-192.168.203.13@tcp:101: Request processed in 526us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.975803:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00010000:00010000:1.0:1790100340.976517:0:10322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100340.976527:0:10322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100340.976580:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140922112:0@lo:103: 00000100:00100000:3.0:1790100340.976589:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140922624:0@lo:103: 00000100:00100000:3.0:1790100340.976597:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140921984:0@lo:103: 00000100:00100000:3.0:1790100340.976603:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140922496:0@lo:103: 00000100:00100000:2.0:1790100340.981438:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233480 going to sleep for 11 seconds 00000100:00100000:1.0:1790100340.984759:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100340.986245:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127243392 00000100:00100000:0.0:1790100340.986256:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127243392 00000100:00100000:0.0:1790100340.986311:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:0.0:1790100340.986321:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127243392:12345-192.168.203.13@tcp:501: 00000100:00100000:0.0:1790100340.986592:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127243392:12345-192.168.203.13@tcp:501: Request processed in 271us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100340.986599:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:2.0:1790100340.988629:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:6500:1877056140923008:192.168.203.13@tcp:105: 00010000:00010000:2.0:1790100340.988655:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.988669:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565d400/0xc87a4f2298286b64 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100340.988681:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100340.988731:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:2422:x1877056127243264:12345-192.168.203.13@tcp:103: Request processed in 13180us (13490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100340.988753:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:0.0:1790100340.994803:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100340.994885:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127243520 00000100:00100000:3.0:1790100340.994893:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127243520 00000100:00100000:3.0:1790100340.994943:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:3.0:1790100340.994953:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6184:x1877056127243520:12345-192.168.203.13@tcp:503: 00000100:00100000:3.0:1790100340.995078:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6184:x1877056127243520:12345-192.168.203.13@tcp:503: Request processed in 125us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100340.995086:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:3.0:1790100341.002843:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100341.003085:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127243648 00000100:00100000:2.0:1790100341.003095:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127243648 00000100:00100000:2.0:1790100341.003143:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:2.0:1790100341.003154:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6651:x1877056127243648:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1790100341.003298:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6651:x1877056127243648:12345-192.168.203.13@tcp:502: Request processed in 145us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100341.003306:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:3.0:1790100341.007138:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100341.007207:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127243776 00000100:00100000:0.0:1790100341.007216:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127243776 00000100:00100000:0.0:1790100341.007271:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:0.0:1790100341.007281:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6651:x1877056127243776:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100341.007439:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6651:x1877056127243776:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 159us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100341.007447:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1790100341.012582:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100341.012847:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127243904 00000100:00100000:0.0:1790100341.012857:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127243904 00000100:00100000:0.0:1790100341.012902:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:0.0:1790100341.012912:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6184:x1877056127243904:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100341.012926:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100341.012942:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e58a00/0xc87a4f2298286b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e041 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.012968:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e58a00/0xc87a4f2298286b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e041 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.012980:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e58a00/0xc87a4f2298286b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e041 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.012989:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e58a00, rc 0) 00000100:00100000:0.0:1790100341.013040:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127243904:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 129us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100341.013048:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:0.0:1790100341.015487:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100341.015523:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127244032 00000100:00100000:0.0:1790100341.015531:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127244032 00000100:00100000:0.0:1790100341.015571:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:0.0:1790100341.015580:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127244032:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100341.015672:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127244032:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 92us (191us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100341.015680:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00010000:00010000:3.0:1790100341.582248:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790100341.674039:0:10376:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7b296890 20000000:00000080:2.0:1790100341.674055:0:10376:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff926083b77800 uarg=0000000000000000 20000000:01000000:2.0:1790100341.674092:0:10376:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790100341.674098:0:10376:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790100341.674102:0:10376:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790100341.674600:0:10377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1790100341.674743:0:10376:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1790100341.680135:0:10376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1790100341.680173:0:10376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1790100341.680189:0:10376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1790100341.680205:0:10376:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790100341.680224:0:10376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680241:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926180030e00/0xc87a4f2298286893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828688c expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680248:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f229828689a expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680255:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982868ee expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680275:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680284:0:10376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680291:0:10376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680326:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680496:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 9 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100341.680510:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923136:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100341.680603:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680611:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 14 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100341.680619:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923264:0@lo:104: 00000100:00100000:2.0:1790100341.680656:0:10376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100341.680694:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f22982868ee expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100341.680702:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f22982868ee expref: 14 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100341.680717:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923392:0@lo:104: 00000100:00100000:2.0:1790100341.680813:0:10376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100341.680850:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790100341.680860:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140923264 00000100:00100000:2.0:1790100341.680867:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140923264 00000100:00100000:2.0:1790100341.680901:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140923392 00000100:00100000:2.0:1790100341.680903:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140923392 00000100:00100000:2.0:1790100341.680917:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790100341.680925:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+4:10376:x1877056140923264:12345-0@lo:104: 00010000:00010000:2.0:1790100341.680948:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100341.681158:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790100341.681171:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:10376:x1877056140923392:12345-0@lo:104: 00010000:00010000:0.0:1790100341.681179:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.681221:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100341.681227:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:10376:x1877056140923392:12345-0@lo:104: Request processed in 58us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100341.681233:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1790100341.681253:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100341.681258:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.681265:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c600 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100341.681269:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.681277:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100341.681284:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100341.681289:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790100341.681315:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.681321:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100341.681362:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.681379:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f22982868ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868f5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.681393:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100341.681395:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100341.681397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100341.681407:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140923520:0@lo:103: 00000100:00100000:3.0:1790100341.681445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100341.681455:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828689a expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.681466:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828689a expref: 14 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100341.681476:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923648:0@lo:104: 00000100:00100000:0.0:1790100341.681501:0:10376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100341.681524:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140923648 00000100:00100000:3.0:1790100341.681529:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140923648 00010000:00010000:0.0:1790100341.681529:0:10376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926180030e00/0xc87a4f2298286893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f229828688c expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100341.681540:0:10376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926180030e00/0xc87a4f2298286893 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f229828688c expref: 14 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100341.681549:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923776:0@lo:104: 00000100:00100000:3.0:1790100341.681555:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790100341.681564:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:10376:x1877056140923648:12345-0@lo:104: 00010000:00010000:3.0:1790100341.681572:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100341.681573:0:10376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100341.681586:0:10376:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100341.681604:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923392:0@lo:104: 00000100:00100000:0.0:1790100341.681639:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923648:0@lo:104: 00010000:00010000:3.0:1790100341.681640:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100341.681650:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:10376:x1877056140923648:12345-0@lo:104: Request processed in 87us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100341.681657:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790100341.681670:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140923776 00000100:00100000:3.0:1790100341.681673:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140923776 00000100:00100000:3.0:1790100341.681687:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790100341.681693:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:10376:x1877056140923776:12345-0@lo:104: 00010000:00010000:3.0:1790100341.681700:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.681739:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100341.681745:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+4:10376:x1877056140923776:12345-0@lo:104: Request processed in 52us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100341.681750:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1790100341.681853:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100341.681859:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100341.681861:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140923520 00000100:00100000:1.0:1790100341.681867:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140923520 00010000:00010000:3.0:1790100341.681870:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189916200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100341.681875:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.681883:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.681890:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982868ee expref: 15 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100341.681892:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100341.681919:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1790100341.681925:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100341.681932:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+15:3643:x1877056140923520:12345-0@lo:103: 00010000:00010000:1.0:1790100341.681941:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100341.681946:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f22982868ee expref: 15 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.681954:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f22982868ee expref: 15 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.681965:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180031e00/0xc87a4f22982868f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f22982868ee expref: 15 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.681990:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100341.682025:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+14:3643:x1877056140923520:12345-0@lo:103: Request processed in 93us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100341.682031:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1790100341.682035:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.682052:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790100341.682062:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140923520:0@lo:103: 00010000:00010000:3.0:1790100341.682066:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.682075:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189916200/0xc87a4f229828689a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f22982868a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100341.682076:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100341.682085:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140923904:0@lo:103: 00010000:00010000:3.0:1790100341.682088:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100341.682093:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.682100:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58c00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100341.682104:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100341.682112:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100341.682115:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100341.682122:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100341.682127:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100341.682145:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100341.682145:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140923904 00000100:00100000:1.0:1790100341.682151:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140923904 00010000:00010000:3.0:1790100341.682154:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100341.682168:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828689a expref: 14 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.682176:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.682191:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f229828688c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286893 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.682202:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100341.682204:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100341.682206:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100341.682212:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790100341.682220:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+14:3643:x1877056140923904:12345-0@lo:103: 00010000:00010000:1.0:1790100341.682228:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100341.682233:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828689a expref: 14 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100341.682235:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140924032:0@lo:103: 00010000:00010000:1.0:1790100341.682248:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828689a expref: 14 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.682260:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189916400/0xc87a4f22982868a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828689a expref: 14 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100341.682269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790100341.682271:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100341.682310:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+13:3643:x1877056140923904:12345-0@lo:103: Request processed in 92us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100341.682316:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790100341.682326:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140924032 00000100:00100000:1.0:1790100341.682329:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140924032 00010000:00010000:1.0:1790100341.682461:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926180030e00/0xc87a4f2298286893 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828688c expref: 13 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100341.682481:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790100341.682488:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+13:3641:x1877056140924032:12345-0@lo:103: 00010000:00010000:1.0:1790100341.682494:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100341.682498:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926180030e00/0xc87a4f2298286893 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f229828688c expref: 13 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.682505:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926180030e00/0xc87a4f2298286893 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f229828688c expref: 13 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.682519:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100341.682549:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+13:3641:x1877056140924032:12345-0@lo:103: Request processed in 61us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100341.682556:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790100341.682581:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140924032:0@lo:103: 00000100:00100000:1.0:1790100341.682601:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140923904:0@lo:103: 00010000:00010000:0.0:1790100341.682678:0:10376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180030e00/0xc87a4f2298286893 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f229828688c expref: 12 pid: 6507 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100341.682699:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923776:0@lo:104: 00010000:00010000:0.0:1790100341.682721:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100341.683190:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100341.683198:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+3:10376:x1877056140923264:12345-0@lo:104: Request processed in 2273us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100341.683206:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790100341.683282:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923264:0@lo:104: 00000100:00100000:0.0:1790100341.683293:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10376:1877056140923136:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100341.683311:0:10376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.683397:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100341.683403:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.683410:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100341.683414:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.683422:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100341.683430:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100341.683435:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790100341.683460:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.683466:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100341.683484:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100341.683494:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140924160:0@lo:103: 00010000:00010000:1.0:1790100341.683505:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59000/0xc87a4f2298286a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286a1b expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.683519:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100341.683522:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100341.683524:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100341.683535:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100341.683734:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140924160 00000100:00100000:1.0:1790100341.683787:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140924160 00010000:00010000:1.0:1790100341.683814:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 12 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100341.683864:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790100341.683871:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184256050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+12:3642:x1877056140924160:12345-0@lo:103: 00010000:00010000:1.0:1790100341.683879:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100341.683884:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 12 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.683892:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 12 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.683902:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180031800/0xc87a4f2298286a1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286a14 expref: 12 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.683911:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100341.683953:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184256050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+11:3642:x1877056140924160:12345-0@lo:103: Request processed in 82us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100341.683959:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790100341.684034:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140924160:0@lo:103: 00000100:00100000:0.0:1790100341.685559:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100341.685601:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127244160 00000100:00100000:3.0:1790100341.685609:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127244160 00010000:00010000:3.0:1790100341.685635:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 10 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100341.685710:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1790100341.685719:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2422:x1877056127244160:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100341.685732:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100341.685737:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 10 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685758:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 10 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685771:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261c2179200/0xc87a4f2298286a7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e002 expref: 10 pid: 6507 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685795:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685815:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685838:0:9513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685845:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685852:0:9513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685859:0:9513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685865:0:9513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100341.685869:0:9513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685876:0:9513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685897:0:9513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100341.685907:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100341.685957:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:2422:x1877056127244160:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 238us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100341.685970:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00010000:00010000:1.0:1790100341.688915:0:10376:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.688942:0:10376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100341.688948:0:10376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926600/0xc87a4f2298286b79 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100342.232565:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100342.232680:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127244288 00000100:00100000:3.0:1790100342.232690:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127244288 00000100:00100000:3.0:1790100342.232742:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:3.0:1790100342.232762:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:6184:x1877056127244288:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100342.232777:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100342.232803:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e048 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100342.232832:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100342.232845:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100342.232853:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565d600, rc 0) 00000100:00100000:3.0:1790100342.233033:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127244288:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 281us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100342.233040:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:0.0:1790100342.239862:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100342.240094:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127244416 00000100:00100000:2.0:1790100342.240104:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127244416 00000100:00100000:2.0:1790100342.240161:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:2.0:1790100342.240172:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127244416:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100342.240316:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127244416:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 146us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100342.240325:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:2.0:1790100342.242493:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100342.245512:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127244544 00000100:00100000:0.0:1790100342.245528:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127244544 00000100:00100000:0.0:1790100342.245616:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:0.0:1790100342.245627:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127244544:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100342.245770:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6184:x1877056127244544:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 145us (3283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100342.245779:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:0.0:1790100342.267990:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100342.268114:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127244672 00000100:00100000:3.0:1790100342.268124:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127244672 00000100:00100000:3.0:1790100342.268179:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:3.0:1790100342.268189:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6709:x1877056127244672:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790100342.268359:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6709:x1877056127244672:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 149us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100342.268368:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:3.0:1790100342.276008:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100342.276139:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127244800 00000100:00100000:0.0:1790100342.276149:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127244800 00000100:00100000:0.0:1790100342.276202:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:0.0:1790100342.276213:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6709:x1877056127244800:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100342.276385:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:6709:x1877056127244800:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 173us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100342.276402:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00010000:00010000:2.0:1790100342.601829:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100343.240642:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100343.240665:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140924288:0@lo:13: 00000100:00100000:0.0:1790100343.240738:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100343.241902:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140924416:0@lo:13: 00000100:00100000:0.0:1790100343.241954:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100343.242030:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140924288 00000100:00100000:1.0:1790100343.242038:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140924288 00000100:00100000:1.0:1790100343.242086:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140924416 00000100:00100000:1.0:1790100343.242089:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140924416 00000100:00100000:1.0:1790100343.242108:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100343.242116:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140924288:12345-0@lo:13: 00002000:00000024:1.0:1790100343.242144:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790100343.242238:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100343.242418:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140924288:12345-0@lo:13: Request processed in 302us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100343.242426:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790100343.242525:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790100343.242534:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140924416:12345-0@lo:13: 00002000:00000024:3.0:1790100343.242546:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100343.242588:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140924416:12345-0@lo:13: Request processed in 53us (630us total) trans 0 rc 0/0 00010000:00080000:0.0:1790100343.242589:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d14e00 x1877056140924288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100343.242601:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100343.242618:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140924288:0@lo:13: 00010000:00080000:0.0:1790100343.242728:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b72300 x1877056140924416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100343.242740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140924416:0@lo:13: 00010000:00010000:0.0:1790100343.625198:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100343.752815:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100343.752841:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140924544:0@lo:41: 00000100:00100000:3.0:1790100343.752915:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100343.754078:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140924544 00000100:00100000:1.0:1790100343.754087:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140924544 00000100:00100000:1.0:1790100343.754135:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790100343.754143:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140924544:12345-0@lo:41: 00000004:00000024:1.0:1790100343.754173:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790100343.754230:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140924544:12345-0@lo:41: Request processed in 87us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100343.754238:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790100343.754272:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140924544:0@lo:41: 00010000:00010000:1.0:1790100344.649901:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790100344.712411:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790100344.712418:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261a6449800 from 48 10000000:01000000:0.0:1790100344.712422:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790100344.712465:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.712486:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.712497:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.712519:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140924672:0@lo:101: 00000100:00100000:0.0:1790100344.712586:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.712634:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093780 going to sleep for 11 seconds 00000100:00100000:3.0:1790100344.712706:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140924672 00000100:00100000:3.0:1790100344.712712:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140924672 00000100:00100000:3.0:1790100344.712751:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1790100344.712759:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+11:6510:x1877056140924672:12345-0@lo:101: 00010000:00010000:3.0:1790100344.712770:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100344.712792:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565d000/0xc87a4f2298286b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286b87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100344.712813:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565d000/0xc87a4f2298286b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286b87 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100344.712823:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565d000/0xc87a4f2298286b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b87 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100344.712832:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565d000, rc 0) 00000100:00100000:3.0:1790100344.712867:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140924672:12345-0@lo:101: Request processed in 109us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100344.712874:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1790100344.712922:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140924672:0@lo:101: 00010000:00010000:3.0:1790100344.712934:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100344.712942:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100344.712998:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140924800:0@lo:501: 00000100:00100000:3.0:1790100344.713018:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100344.713029:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100344.713039:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140924800 00000100:00100000:3.0:1790100344.713042:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140924800 00000100:00100000:3.0:1790100344.713059:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790100344.713064:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140924800:12345-0@lo:501: 00000100:00100000:3.0:1790100344.713153:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140924800:12345-0@lo:501: Request processed in 89us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100344.713160:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790100344.713182:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140924800:0@lo:501: 00000100:00100000:3.0:1790100344.713202:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140924928:0@lo:503: 00000100:00100000:3.0:1790100344.713233:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100344.713243:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100344.713252:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140924928 00000100:00100000:3.0:1790100344.713255:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140924928 00000100:00100000:3.0:1790100344.713272:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790100344.713278:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140924928:12345-0@lo:503: 00000100:00100000:3.0:1790100344.713355:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140924928:12345-0@lo:503: Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100344.713368:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790100344.713401:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140924928:0@lo:503: 00000100:00100000:1.0:1790100344.713872:0:10570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10570:1877056140925056:0@lo:502: 00000100:00100000:1.0:1790100344.713904:0:10570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.713936:0:10570:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5aad000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100344.713984:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140925056 00000100:00100000:3.0:1790100344.713987:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140925056 00000100:00100000:3.0:1790100344.714013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1790100344.714019:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:10570:x1877056140925056:12345-0@lo:502: 00000100:00100000:3.0:1790100344.714083:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+12:10570:x1877056140925056:12345-0@lo:502: Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100344.714090:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1790100344.714158:0:10570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10570:1877056140925056:0@lo:502: 00000100:00100000:1.0:1790100344.714188:0:10570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10570:1877056140925184:0@lo:502: 00000100:00100000:1.0:1790100344.714213:0:10570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.714231:0:10570:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5aad000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100344.714276:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140925184 00000100:00100000:3.0:1790100344.714280:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140925184 00000100:00100000:3.0:1790100344.714306:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1790100344.714312:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:10570:x1877056140925184:12345-0@lo:502: 00000100:00100000:3.0:1790100344.714379:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+12:10570:x1877056140925184:12345-0@lo:502: Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100344.714385:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1790100344.714451:0:10570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10570:1877056140925184:0@lo:502: 00000040:00080000:1.0:1790100344.714467:0:10570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790100344.714607:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790100344.714624:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790100344.714631:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100344.714640:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100344.714648:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1790100344.714650:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1790100344.714652:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790100344.714674:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100344.714682:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100344.714690:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100344.714700:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140925312:0@lo:101: 00000100:00100000:3.0:1790100344.714722:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100344.714744:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a63d1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.714791:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140925312 00000100:00100000:1.0:1790100344.714795:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140925312 00000100:00100000:1.0:1790100344.714825:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1790100344.714831:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+12:6510:x1877056140925312:12345-0@lo:101: 00010000:00010000:1.0:1790100344.714839:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100344.714849:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7c00/0xc87a4f2298286b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286b95 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.714866:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7c00/0xc87a4f2298286b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286b95 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.714875:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7c00/0xc87a4f2298286b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286b95 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.714881:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7c00, rc 0) 00000100:00100000:1.0:1790100344.714911:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+13:6510:x1877056140925312:12345-0@lo:101: Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.714916:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1790100344.714943:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140925312:0@lo:101: 00010000:00010000:1.0:1790100344.714952:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.714966:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100344.715001:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140925440:0@lo:501: 00000100:00100000:1.0:1790100344.715025:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.715040:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5aadcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.715052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140925440 00000100:00100000:1.0:1790100344.715055:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140925440 00000100:00100000:1.0:1790100344.715075:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1790100344.715082:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+13:6510:x1877056140925440:12345-0@lo:501: 00000100:00100000:1.0:1790100344.715173:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+13:6510:x1877056140925440:12345-0@lo:501: Request processed in 90us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.715179:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1790100344.715206:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140925440:0@lo:501: 00000100:00100000:1.0:1790100344.715228:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140925568:0@lo:503: 00000100:00100000:1.0:1790100344.715258:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.715280:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5aadcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100344.715331:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140925568 00000100:00100000:3.0:1790100344.715336:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140925568 00000100:00100000:2.0:1790100344.715391:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1790100344.715403:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+13:6510:x1877056140925568:12345-0@lo:503: 00000100:00100000:2.0:1790100344.715546:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+13:6510:x1877056140925568:12345-0@lo:503: Request processed in 146us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100344.715554:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1790100344.715651:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140925568:0@lo:503: 00000100:00100000:3.0:1790100344.719080:0:10571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10571:1877056140925696:0@lo:502: 00000100:00100000:3.0:1790100344.719153:0:10571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.719188:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140925696 00000100:00100000:3.0:1790100344.719190:0:10571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cce900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.719197:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140925696 00000100:00100000:1.0:1790100344.719248:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1790100344.719257:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+13:10571:x1877056140925696:12345-0@lo:502: 00000100:00100000:1.0:1790100344.719401:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+13:10571:x1877056140925696:12345-0@lo:502: Request processed in 145us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.719408:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1790100344.719680:0:10571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10571:1877056140925696:0@lo:502: 00000020:01000000:2.0:1790100344.719710:0:10571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100344.719718:0:10571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100344.719720:0:10571:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790100344.719724:0:10571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790100344.719742:0:10571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10571:1877056140925824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100344.719773:0:10571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100344.719805:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140925824 00000100:00100000:2.0:1790100344.719809:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140925824 00000100:00100000:2.0:1790100344.719836:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1790100344.719842:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+13:10571:x1877056140925824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100344.720397:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+13:10571:x1877056140925824:12345-0@lo:502:llog_process_th.0 Request processed in 553us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100344.720405:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1790100344.720446:0:10571:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100344.720459:0:10571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10571:1877056140925824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100344.720492:0:10571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100344.720497:0:10571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100344.720499:0:10571:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790100344.720503:0:10571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1790100344.720592:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1790100344.720616:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790100344.720626:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.720638:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100344.720646:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100344.720649:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261a6449800 from 4 10000000:01000000:1.0:1790100344.720651:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100344.720675:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.720683:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.720692:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100344.720707:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140925952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.720740:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.720767:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5aadd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100344.723094:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140925952 00000100:00100000:2.0:1790100344.723108:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140925952 00000100:00100000:2.0:1790100344.723161:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1790100344.723170:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+13:6510:x1877056140925952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100344.723185:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100344.723200:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286ba3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100344.723226:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100344.723236:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100344.723244:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926a00, rc 0) 00000100:00100000:2.0:1790100344.723317:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140925952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (2575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100344.723323:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790100344.723441:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140925952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100344.723461:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.723479:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100344.723554:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.723581:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.723609:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5aadd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790100344.723771:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140926080 00000100:00100000:3.0:1790100344.723788:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140926080 00000100:00100000:3.0:1790100344.723820:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790100344.723828:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140926080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100344.724039:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140926080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100344.724046:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1790100344.724117:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.724147:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.724185:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.724209:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5aadd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100344.724248:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140926208 00000100:00100000:2.0:1790100344.724252:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140926208 00000100:00100000:2.0:1790100344.724276:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790100344.724282:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140926208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100344.724387:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140926208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100344.724393:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790100344.724494:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100344.724861:0:10572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10572:1877056140926336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100344.724895:0:10572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100344.725018:0:10572:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55480 going to sleep for 11 seconds 00000100:00100000:3.0:1790100344.729613:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140926336 00000100:00100000:3.0:1790100344.729624:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140926336 00000100:00100000:3.0:1790100344.729680:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1790100344.729691:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:10572:x1877056140926336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100344.729858:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+14:10572:x1877056140926336:12345-0@lo:502:llog_process_th.0 Request processed in 169us (4961us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100344.729872:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790100344.730023:0:10572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10572:1877056140926336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100344.730055:0:10572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100344.730149:0:10572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100344.730151:0:10572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790100344.730159:0:10572:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261a6449800 00000020:00000080:1.0:1790100344.730161:0:10572:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790100344.730246:0:10572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10572:1877056140926464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.730290:0:10572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.730322:0:10572:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5aadd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.730476:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140926464 00000100:00100000:0.0:1790100344.730482:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140926464 00000100:00100000:0.0:1790100344.730518:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790100344.730527:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:10572:x1877056140926464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.730609:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:10572:x1877056140926464:12345-0@lo:502:llog_process_th.0 Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.730616:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790100344.731434:0:10572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10572:1877056140926464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.731464:0:10572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100344.731472:0:10572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.731474:0:10572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790100344.731478:0:10572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790100344.731620:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790100344.731640:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790100344.731650:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100344.731662:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100344.731671:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790100344.731673:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b6950800 from 48 10000000:01000000:2.0:1790100344.731676:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790100344.731704:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100344.731712:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100344.731721:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100344.731737:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790100344.731775:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100344.731818:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.731862:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140926592 00000100:00100000:0.0:1790100344.731868:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140926592 00000100:00100000:0.0:1790100344.731906:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790100344.731913:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+14:6510:x1877056140926592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.731924:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100344.731936:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e58600/0xc87a4f2298286bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286bb1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.731957:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e58600/0xc87a4f2298286bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286bb1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.731966:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e58600/0xc87a4f2298286bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286bb1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.731987:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e58600, rc 0) 00000100:00100000:0.0:1790100344.732023:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140926592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.732029:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790100344.732072:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.732084:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.732092:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.732136:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.732161:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.732176:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.732187:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140926720 00000100:00100000:0.0:1790100344.732189:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140926720 00000100:00100000:0.0:1790100344.732204:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790100344.732208:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140926720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.732304:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140926720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.732310:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790100344.732364:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.732391:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.732425:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.732450:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.732460:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140926848 00000100:00100000:0.0:1790100344.732463:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140926848 00000100:00100000:0.0:1790100344.732477:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790100344.732482:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140926848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.732543:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140926848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.732548:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790100344.732584:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140926848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.732753:0:10573:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10573:1877056140926976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.732805:0:10573:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.732829:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140926976 00000100:00100000:0.0:1790100344.732833:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140926976 00000100:00100000:0.0:1790100344.732852:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790100344.732858:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:10573:x1877056140926976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.732925:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:10573:x1877056140926976:12345-0@lo:502:llog_process_th.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.732932:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790100344.732960:0:10573:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.732972:0:10573:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10573:1877056140926976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.733009:0:10573:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10573:1877056140927104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.733043:0:10573:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.733061:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140927104 00000100:00100000:0.0:1790100344.733065:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140927104 00000100:00100000:0.0:1790100344.733083:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790100344.733090:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:10573:x1877056140927104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.733153:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:10573:x1877056140927104:12345-0@lo:502:llog_process_th.0 Request processed in 64us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.733160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790100344.733188:0:10573:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.733200:0:10573:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10573:1877056140927104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790100344.733218:0:10573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790100344.733260:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790100344.733274:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100344.733281:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.733289:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100344.733297:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790100344.733299:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1790100344.733301:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790100344.733317:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.733325:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.733333:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.734052:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140927232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.734088:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.734129:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.736576:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140927232 00000100:00100000:1.0:1790100344.736590:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140927232 00000100:00100000:1.0:1790100344.736644:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790100344.736653:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+15:6510:x1877056140927232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100344.736668:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100344.736684:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7600/0xc87a4f2298286bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286bbf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.736722:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7600/0xc87a4f2298286bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286bbf expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.736732:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7600/0xc87a4f2298286bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286bbf expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.736741:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7600, rc 0) 00000100:00100000:1.0:1790100344.736828:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140927232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.736834:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790100344.737169:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140927232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.737189:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.737200:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.737439:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140927360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.737477:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.737508:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100344.737553:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140927360 00000100:00100000:2.0:1790100344.737559:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140927360 00000100:00100000:2.0:1790100344.737590:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790100344.737597:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140927360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100344.737723:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140927360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100344.737739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790100344.738113:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140927360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.738142:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140927488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.738825:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.739297:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100344.741182:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140927488 00000100:00100000:2.0:1790100344.741194:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140927488 00000100:00100000:2.0:1790100344.741248:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790100344.741258:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140927488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100344.741420:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140927488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100344.741429:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790100344.741454:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140927488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.745753:0:10578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10578:1877056140927616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.745841:0:10578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.745938:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140927616 00000100:00100000:0.0:1790100344.745946:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140927616 00000100:00100000:0.0:1790100344.745989:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790100344.745998:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:10578:x1877056140927616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.746112:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+16:10578:x1877056140927616:12345-0@lo:502:llog_process_th.0 Request processed in 115us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.746120:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790100344.746179:0:10578:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.746200:0:10578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10578:1877056140927616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.746227:0:10578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100344.746236:0:10578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.746239:0:10578:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790100344.746244:0:10578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790100344.746264:0:10578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10578:1877056140927744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.746446:0:10578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.746470:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140927744 00000100:00100000:0.0:1790100344.746475:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140927744 00000100:00100000:0.0:1790100344.746500:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790100344.746506:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:10578:x1877056140927744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.746642:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+16:10578:x1877056140927744:12345-0@lo:502:llog_process_th.0 Request processed in 66us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.746711:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790100344.746745:0:10578:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.746758:0:10578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10578:1877056140927744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.746775:0:10578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100344.746790:0:10578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.746792:0:10578:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790100344.746796:0:10578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1790100344.747001:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1790100344.747019:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790100344.747029:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.747041:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100344.747061:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100344.747064:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b6950800 from 4 10000000:01000000:0.0:1790100344.747067:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100344.747091:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.747099:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.747109:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.747123:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140927872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.747150:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.747285:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.749417:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140927872 00000100:00100000:1.0:1790100344.749429:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140927872 00000100:00100000:1.0:1790100344.749474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790100344.749482:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+16:6510:x1877056140927872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100344.749495:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100344.749511:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286bcd expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.749538:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.749548:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.749556:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6800, rc 0) 00000100:00100000:1.0:1790100344.750086:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140927872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 603us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.750093:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790100344.750170:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140927872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100344.750190:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.750206:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100344.750941:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.750980:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.751012:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.751041:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140928000 00000100:00100000:1.0:1790100344.751046:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140928000 00000100:00100000:1.0:1790100344.751078:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790100344.751085:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140928000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.751193:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140928000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.751201:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790100344.751237:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.751267:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.751324:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.752284:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.752304:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140928128 00000100:00100000:1.0:1790100344.752310:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140928128 00000100:00100000:1.0:1790100344.752363:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790100344.752372:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140928128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.752474:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140928128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.752488:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790100344.752549:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.756896:0:10580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10580:1877056140928256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.756969:0:10580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.757006:0:10580:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.765305:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140928256 00000100:00100000:0.0:1790100344.765318:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140928256 00000100:00100000:0.0:1790100344.765392:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790100344.765402:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:10580:x1877056140928256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.765943:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+17:10580:x1877056140928256:12345-0@lo:502:llog_process_th.0 Request processed in 541us (8972us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.765951:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790100344.766016:0:10580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10580:1877056140928256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.766056:0:10580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100344.766066:0:10580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.766068:0:10580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790100344.766074:0:10580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261b6950800 00000020:00000080:0.0:1790100344.766077:0:10580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790100344.766142:0:10580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10580:1877056140928384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.766182:0:10580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.766211:0:10580:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.766292:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140928384 00000100:00100000:1.0:1790100344.766297:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140928384 00000100:00100000:1.0:1790100344.766329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790100344.766358:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:10580:x1877056140928384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.766436:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+17:10580:x1877056140928384:12345-0@lo:502:llog_process_th.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.766442:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790100344.766567:0:10580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10580:1877056140928384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.766718:0:10580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100344.766723:0:10580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.766725:0:10580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790100344.766729:0:10580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790100344.766923:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790100344.766940:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100344.766949:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.766960:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100344.766968:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790100344.766971:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b2026000 from 48 10000000:01000000:1.0:1790100344.766974:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100344.766995:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.767003:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.767011:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100344.767037:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.767067:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.767090:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5b3a900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.767137:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140928512 00000100:00100000:0.0:1790100344.767142:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140928512 00000100:00100000:0.0:1790100344.767170:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790100344.767176:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+17:6510:x1877056140928512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.767185:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100344.767195:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286bdb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.767214:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286bdb expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.767223:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286bdb expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.767231:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e59200, rc 0) 00000100:00100000:0.0:1790100344.767259:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140928512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.767357:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100344.767369:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.767376:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100344.767420:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.767442:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.767455:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5b3a900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.767507:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790100344.767531:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140928640 00000100:00100000:0.0:1790100344.767535:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140928640 00000100:00100000:0.0:1790100344.767555:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790100344.767561:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140928640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.769237:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140928640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1671us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.769247:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790100344.769355:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.769400:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.769532:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.769560:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5b3a900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.769710:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140928768 00000100:00100000:0.0:1790100344.769716:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140928768 00000100:00100000:0.0:1790100344.769750:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790100344.769757:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140928768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.770044:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140928768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 287us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.770052:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790100344.770210:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140928768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.770833:0:10581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10581:1877056140928896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.771760:0:10581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.771802:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140928896 00000100:00100000:0.0:1790100344.771809:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140928896 00000100:00100000:0.0:1790100344.771840:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1790100344.771916:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:10581:x1877056140928896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.772017:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+18:10581:x1877056140928896:12345-0@lo:502:llog_process_th.0 Request processed in 169us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.772033:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1790100344.772080:0:10581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.772096:0:10581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10581:1877056140928896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.772139:0:10581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10581:1877056140929024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.772246:0:10581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.772320:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140929024 00000100:00100000:0.0:1790100344.772324:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140929024 00000100:00100000:0.0:1790100344.772366:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790100344.772373:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+18:10581:x1877056140929024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.772435:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+18:10581:x1877056140929024:12345-0@lo:502:llog_process_th.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.773082:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790100344.773153:0:10581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.773277:0:10581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10581:1877056140929024:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790100344.773303:0:10581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790100344.773740:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790100344.773762:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100344.773771:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.773793:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100344.773802:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1790100344.773805:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1790100344.773808:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790100344.773840:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.774037:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.774047:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.774065:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140929152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.774210:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.774263:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.774281:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140929152 00000100:00100000:0.0:1790100344.774286:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140929152 00000100:00100000:0.0:1790100344.774488:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790100344.774498:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+18:6510:x1877056140929152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.774510:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100344.774520:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e59600/0xc87a4f2298286bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286be9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.774716:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e59600/0xc87a4f2298286bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286be9 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.774727:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e59600/0xc87a4f2298286bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286be9 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.774735:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e59600, rc 0) 00000100:00100000:0.0:1790100344.774771:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140929152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.774787:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790100344.775094:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140929152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.775109:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.775119:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.775171:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140929280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.775200:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.775221:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.775235:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140929280 00000100:00100000:0.0:1790100344.775239:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140929280 00000100:00100000:0.0:1790100344.775263:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790100344.775270:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140929280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.775398:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140929280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.775404:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790100344.775437:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140929280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.775465:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140929408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.775506:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.775526:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.775537:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140929408 00000100:00100000:0.0:1790100344.775541:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140929408 00000100:00100000:0.0:1790100344.775562:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790100344.775569:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140929408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.776748:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140929536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100344.776796:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.776908:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140929536 00000100:00100000:1.0:1790100344.776914:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140929536 00000100:00100000:1.0:1790100344.776949:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790100344.776957:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140929536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790100344.776983:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790100344.777033:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140929536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.777040:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790100344.777086:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140929536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100344.777243:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140929408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1674us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.777258:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790100344.777372:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140929408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.777985:0:10583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10583:1877056140929664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.778030:0:10583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.778099:0:10583:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.778133:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140929664 00000100:00100000:0.0:1790100344.778139:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140929664 00000100:00100000:0.0:1790100344.778210:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1790100344.778220:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+19:10583:x1877056140929664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.778316:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+19:10583:x1877056140929664:12345-0@lo:502:llog_process_th.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.778323:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790100344.778517:0:10583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10583:1877056140929664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100344.778550:0:10583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100344.778558:0:10583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100344.778560:0:10583:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790100344.778567:0:10583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790100344.778602:0:10583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10583:1877056140929792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.778637:0:10583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.778671:0:10583:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365000 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.778806:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140929792 00000100:00100000:0.0:1790100344.778810:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140929792 00000100:00100000:0.0:1790100344.778839:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1790100344.778944:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+19:10583:x1877056140929792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.779049:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+19:10583:x1877056140929792:12345-0@lo:502:llog_process_th.0 Request processed in 202us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.779055:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790100344.779110:0:10583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10583:1877056140929792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100344.779128:0:10583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100344.779131:0:10583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100344.779133:0:10583:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790100344.779136:0:10583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1790100344.779294:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1790100344.779313:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790100344.779322:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.779333:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100344.779366:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100344.779368:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b2026000 from 4 10000000:01000000:0.0:1790100344.779371:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100344.779394:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.779408:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.779418:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.779433:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140929920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.779462:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.779485:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.779497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140929920 00000100:00100000:0.0:1790100344.779502:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140929920 00000100:00100000:0.0:1790100344.779527:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1790100344.779534:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+19:6510:x1877056140929920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.779542:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100344.779553:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286bf7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.779582:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.779592:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.779600:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e59000, rc 0) 00000100:00100000:0.0:1790100344.779630:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140929920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.779637:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1790100344.779686:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140929920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.779697:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.779706:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.779758:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.779793:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.779809:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.779822:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140930048 00000100:00100000:0.0:1790100344.779826:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140930048 00000100:00100000:0.0:1790100344.779862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1790100344.779869:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140930048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.779960:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140930048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.779967:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1790100344.780001:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.780024:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.780057:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.780070:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.780080:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140930176 00000100:00100000:0.0:1790100344.780084:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140930176 00000100:00100000:0.0:1790100344.780103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790100344.780109:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140930176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.780173:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140930176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.780185:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790100344.780221:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.780426:0:10584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10584:1877056140930304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.780459:0:10584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.780478:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140930304 00000100:00100000:0.0:1790100344.780481:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140930304 00000100:00100000:0.0:1790100344.780502:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790100344.780508:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:10584:x1877056140930304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.780572:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:10584:x1877056140930304:12345-0@lo:502:llog_process_th.0 Request processed in 63us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.780579:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790100344.780614:0:10584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.780626:0:10584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10584:1877056140930304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.780646:0:10584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100344.780653:0:10584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.780655:0:10584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790100344.780661:0:10584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261b2026000 00000020:00000080:0.0:1790100344.780663:0:10584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790100344.780732:0:10584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10584:1877056140930432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.780766:0:10584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.780798:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140930432 00000100:00100000:0.0:1790100344.780802:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140930432 00000100:00100000:0.0:1790100344.780823:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790100344.780829:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:10584:x1877056140930432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.780887:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+20:10584:x1877056140930432:12345-0@lo:502:llog_process_th.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.780899:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790100344.780924:0:10584:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d10180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.780936:0:10584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10584:1877056140930432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.780953:0:10584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100344.780957:0:10584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.780958:0:10584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790100344.780962:0:10584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790100344.781007:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790100344.781020:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100344.781026:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.781034:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100344.781042:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790100344.781044:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926187007800 from 48 10000000:01000000:0.0:1790100344.781047:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790100344.781065:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.781071:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.781078:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.781090:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.781125:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.781147:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6233b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.781162:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140930560 00000100:00100000:0.0:1790100344.781165:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140930560 00000100:00100000:0.0:1790100344.781187:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1790100344.781193:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140930560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.781201:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100344.781211:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e58400/0xc87a4f2298286c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286c05 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.781227:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e58400/0xc87a4f2298286c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286c05 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.781236:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e58400/0xc87a4f2298286c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c05 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.781243:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e58400, rc 0) 00000100:00100000:0.0:1790100344.781272:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140930560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.781278:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1790100344.781310:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.781322:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.781330:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.781427:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.781453:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.781483:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.781494:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140930688 00000100:00100000:0.0:1790100344.781497:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140930688 00000100:00100000:0.0:1790100344.781526:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1790100344.781535:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140930688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.781622:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140930688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.781629:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1790100344.781874:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.781907:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.781949:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.781971:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.781992:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140930816 00000100:00100000:0.0:1790100344.781997:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140930816 00000100:00100000:0.0:1790100344.782023:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790100344.782029:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140930816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.782098:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140930816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.782106:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790100344.782148:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140930816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.782375:0:10585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10585:1877056140930944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.782411:0:10585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.782427:0:10585:0:(client.c:2716:ptlrpc_set_wait()) set ffff926193365000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.783404:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140930944 00000100:00100000:1.0:1790100344.783411:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140930944 00000100:00100000:1.0:1790100344.783445:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790100344.783453:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:10585:x1877056140930944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.783568:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:10585:x1877056140930944:12345-0@lo:502:llog_process_th.0 Request processed in 115us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.783707:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790100344.783758:0:10585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10585:1877056140930944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.783815:0:10585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10585:1877056140931072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.783919:0:10585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.783936:0:10585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccda80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.784150:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140931072 00000100:00100000:0.0:1790100344.784156:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140931072 00000100:00100000:0.0:1790100344.784186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790100344.784194:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:10585:x1877056140931072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.784271:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:10585:x1877056140931072:12345-0@lo:502:llog_process_th.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.784279:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790100344.784319:0:10585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10585:1877056140931072:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790100344.784721:0:10585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790100344.784786:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790100344.784813:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100344.784822:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.784832:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100344.784842:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790100344.784854:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1790100344.784858:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790100344.784897:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.784905:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.784915:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.784929:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.784961:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.784987:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.785002:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140931200 00000100:00100000:0.0:1790100344.785005:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140931200 00000100:00100000:0.0:1790100344.785030:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790100344.785036:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140931200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.785045:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100344.785056:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083e46600/0xc87a4f2298286c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286c13 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.785088:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083e46600/0xc87a4f2298286c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286c13 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.785098:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083e46600/0xc87a4f2298286c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c13 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.785106:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46600, rc 0) 00000100:00100000:0.0:1790100344.785140:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140931200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.785146:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790100344.785189:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.785203:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.785212:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.785260:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.785286:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.785301:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.785315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140931328 00000100:00100000:0.0:1790100344.785318:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140931328 00000100:00100000:0.0:1790100344.785366:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790100344.785374:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140931328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.785466:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140931328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.785481:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790100344.785518:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.785543:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.785597:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.785620:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc6480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.785634:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140931456 00000100:00100000:0.0:1790100344.785638:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140931456 00000100:00100000:0.0:1790100344.785671:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790100344.785676:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140931456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.785750:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140931456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.785756:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790100344.785804:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100344.787285:0:10586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10586:1877056140931584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.788038:0:10586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.788078:0:10586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.788122:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140931584 00000100:00100000:0.0:1790100344.788129:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140931584 00000100:00100000:0.0:1790100344.788171:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790100344.788179:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+22:10586:x1877056140931584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.788292:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+22:10586:x1877056140931584:12345-0@lo:502:llog_process_th.0 Request processed in 113us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.788299:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790100344.788474:0:10586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10586:1877056140931584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100344.788504:0:10586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100344.788512:0:10586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100344.788514:0:10586:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790100344.788520:0:10586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790100344.788544:0:10586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10586:1877056140931712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100344.788579:0:10586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.788602:0:10586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccd600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.788732:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140931712 00000100:00100000:0.0:1790100344.788735:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140931712 00000100:00100000:0.0:1790100344.788762:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790100344.788771:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:10586:x1877056140931712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.788931:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:10586:x1877056140931712:12345-0@lo:502:llog_process_th.0 Request processed in 162us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.788938:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790100344.788992:0:10586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10586:1877056140931712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100344.789011:0:10586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100344.789015:0:10586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100344.789017:0:10586:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790100344.789020:0:10586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1790100344.789091:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1790100344.789109:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790100344.789118:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.789129:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100344.789138:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100344.789141:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926187007800 from 4 10000000:01000000:0.0:1790100344.789144:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100344.789167:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.789175:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.789184:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.789199:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.789231:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.789249:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.789255:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140931840 00000100:00100000:1.0:1790100344.789259:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140931840 00000100:00100000:1.0:1790100344.789498:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790100344.789507:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140931840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100344.789516:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100344.789528:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286c21 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.789547:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.789558:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100344.789566:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6600, rc 0) 00000100:00100000:1.0:1790100344.789597:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140931840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.789603:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790100344.789713:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.789726:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.789741:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.789795:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.789819:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100344.789864:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140931968 00000100:00100000:1.0:1790100344.789869:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140931968 00000100:00100000:1.0:1790100344.789891:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790100344.789897:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140931968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.789909:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100344.789981:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140931968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100344.789995:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790100344.790122:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140931968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.790149:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140932096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.790184:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.790201:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.790218:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140932096 00000100:00100000:0.0:1790100344.790222:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140932096 00000100:00100000:0.0:1790100344.790252:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790100344.790259:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140932096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.790335:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140932096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.790367:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790100344.790405:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140932096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.790556:0:10587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10587:1877056140932224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.790730:0:10587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.790756:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140932224 00000100:00100000:0.0:1790100344.790760:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140932224 00000100:00100000:0.0:1790100344.790792:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1790100344.790800:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:10587:x1877056140932224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.790944:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:10587:x1877056140932224:12345-0@lo:502:llog_process_th.0 Request processed in 143us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.790951:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1790100344.790989:0:10587:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc9900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.791001:0:10587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10587:1877056140932224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.791019:0:10587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100344.791027:0:10587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.791029:0:10587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790100344.791035:0:10587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff926187007800 00000020:00000080:0.0:1790100344.791037:0:10587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790100344.791106:0:10587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10587:1877056140932352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.791138:0:10587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.791157:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140932352 00000100:00100000:0.0:1790100344.791160:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140932352 00000100:00100000:0.0:1790100344.791177:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790100344.791182:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:10587:x1877056140932352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100344.791238:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:10587:x1877056140932352:12345-0@lo:502:llog_process_th.0 Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.791245:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790100344.791277:0:10587:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc9900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.791289:0:10587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:10587:1877056140932352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100344.791325:0:10587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100344.791330:0:10587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100344.791331:0:10587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790100344.791335:0:10587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790100344.791428:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790100344.791453:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100344.791461:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.791469:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100344.791477:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790100344.791480:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9261b2304d40 from 1 10000000:01000000:0.0:1790100344.791482:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790100344.791501:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.791509:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.791518:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.791530:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140932480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.791556:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.791728:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc9900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.791743:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140932480 00000100:00100000:0.0:1790100344.791746:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140932480 00000100:00100000:0.0:1790100344.791769:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790100344.791774:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140932480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.791793:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100344.791853:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083e47200/0xc87a4f2298286c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286c2f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.791883:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083e47200/0xc87a4f2298286c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286c2f expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.791893:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083e47200/0xc87a4f2298286c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c2f expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.791901:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47200, rc 0) 00000100:00100000:0.0:1790100344.791932:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140932480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100344.791937:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790100344.791967:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140932480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100344.791978:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c36 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.791986:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c36 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100344.792025:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140932608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.792046:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100344.792058:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8cc9900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100344.792069:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140932608 00000100:00100000:0.0:1790100344.792073:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140932608 00000100:00100000:0.0:1790100344.792095:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790100344.792107:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140932608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100344.792168:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140932608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100344.792182:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790100344.792212:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140932608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1790100344.792227:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790100344.792231:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c36 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100344.792237:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c36 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100345.177498:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100345.177562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100345.177579:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100345.177594:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100345.177612:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100345.177635:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127245184 00000100:00100000:2.0:1790100345.177643:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127245184 00000100:00100000:2.0:1790100345.177689:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127245056 00000100:00100000:2.0:1790100345.177692:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127245056 00000100:00100000:2.0:1790100345.177723:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1790100345.177734:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245184:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100345.177809:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245184:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100345.177816:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1790100345.177830:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1790100345.177836:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127245056:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100345.177860:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127245056:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100345.177865:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1790100345.177889:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127245440 00000100:00100000:2.0:1790100345.177892:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127245440 00000100:00100000:2.0:1790100345.177915:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127245312 00000100:00100000:2.0:1790100345.177918:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127245312 00000100:00100000:2.0:1790100345.177937:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1790100345.177943:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245440:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100345.177970:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245440:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100345.177976:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1790100345.177986:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1790100345.177992:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245312:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100345.178014:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245312:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100345.178020:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00080000:2.0:1790100345.178034:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100345.178038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100345.178040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100345.178042:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100345.183766:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127244928 00000100:00100000:0.0:1790100345.183791:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127244928 00000100:00100000:0.0:1790100345.184036:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:0.0:1790100345.184051:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127244928:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100345.184129:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127244928:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 82us (6637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100345.184136:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:0.0:1790100345.288511:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140932864:0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.288582:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100345.288583:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140932736:0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.288625:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100345.288645:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140933376:0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.288653:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140933248:0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.288678:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100345.290445:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140932864 00000100:00100000:1.0:1790100345.290456:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140932864 00000100:00100000:1.0:1790100345.290510:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790100345.290518:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140932864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.292101:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140933888:0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.292160:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100345.292198:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100345.292210:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140933376 00000100:00100000:0.0:1790100345.292216:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140933376 00000100:00100000:2.0:1790100345.292235:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140933760:0@lo:400:kworker.0 00000100:00100000:1.0:1790100345.292261:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140932864:12345-0@lo:400:kworker.0 Request processed in 1741us (3679us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100345.292273:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100345.292274:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790100345.292275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100345.292298:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140933376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100345.292300:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140932736 00000100:00100000:3.0:1790100345.292307:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140932736 00000100:00100000:2.0:1790100345.292336:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140932992:0@lo:400:kworker.0 00000100:00100000:3.0:1790100345.292362:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140933888 00000100:00100000:3.0:1790100345.292367:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140933888 00000100:00100000:0.0:1790100345.292371:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140933376:12345-0@lo:400:kworker.0 Request processed in 76us (3691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100345.292380:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790100345.292390:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140933248 00000100:00100000:3.0:1790100345.292394:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140933248 00000100:00080000:0.0:1790100345.292405:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100345.292411:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100345.292412:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140933760 00000100:00100000:3.0:1790100345.292416:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140933760 00000100:00100000:3.0:1790100345.292443:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1790100345.292446:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b72680 x1877056140933376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100345.292455:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140932736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.292466:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140933376:0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.292485:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140932864:0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.292504:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100345.292511:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140932736:12345-0@lo:400:kworker.0 Request processed in 58us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100345.292515:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140934272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100345.292522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100345.292524:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100345.292540:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140932992 00000100:00100000:3.0:1790100345.292544:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140932992 00000100:00100000:2.0:1790100345.292556:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140933504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100345.292558:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100345.292564:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790100345.292571:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140933888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.292605:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790100345.292607:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100345.292620:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140933888:12345-0@lo:400:kworker.0 Request processed in 47us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100345.292624:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140934272 00000100:00100000:3.0:1790100345.292629:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790100345.292630:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140934272 00000100:00100000:2.0:1790100345.292634:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140934016:0@lo:400:kworker.0 00000100:00100000:3.0:1790100345.292648:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790100345.292658:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140933248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.292669:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140933504 00000100:00100000:2.0:1790100345.292670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100345.292676:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140933504 00000100:00100000:3.0:1790100345.292695:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140933248:12345-0@lo:400:kworker.0 Request processed in 38us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100345.292701:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790100345.292704:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790100345.292709:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790100345.292714:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140934272:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100345.292721:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140933120:0@lo:400:kworker.0 00000100:00100000:3.0:1790100345.292722:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00002000:00000024:0.0:1790100345.292736:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100345.292739:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140933760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100345.292790:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140933760:12345-0@lo:400:kworker.0 Request processed in 53us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100345.292799:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790100345.292800:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140934272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100345.292809:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790100345.292815:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790100345.292824:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140932992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100345.292830:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790100345.292839:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140933504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100345.292873:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100345.292886:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140933632:0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.292905:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100345.292922:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140934144:0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.292938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100345.292964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140933120 00000100:00100000:2.0:1790100345.292968:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140933120 00000100:00100000:2.0:1790100345.292990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790100345.292997:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140933120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.293031:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140933120:12345-0@lo:400:kworker.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100345.293037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790100345.293063:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140934016 00000100:00100000:2.0:1790100345.293066:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140934016 00000100:00100000:2.0:1790100345.293084:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140933632 00000100:00100000:2.0:1790100345.293086:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140933632 00000100:00100000:2.0:1790100345.293098:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140934144 00000100:00100000:2.0:1790100345.293100:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140934144 00000100:00100000:2.0:1790100345.293110:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790100345.293116:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140934016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.293156:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140934016:12345-0@lo:400:kworker.0 Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100345.293169:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790100345.293181:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100345.293186:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140933632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.293211:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140933632:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100345.293217:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100345.293226:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100345.293231:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056140934144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.293253:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056140934144:12345-0@lo:400:kworker.0 Request processed in 21us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100345.293258:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100345.293283:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140933120:0@lo:400:kworker.0 00010000:00080000:2.0:1790100345.293293:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b71500 x1877056140933632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100345.293302:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140933632:0@lo:400:kworker.0 00010000:00080000:2.0:1790100345.293310:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b72d80 x1877056140934144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100345.293317:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1790100345.293327:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140934144:0@lo:400:kworker.0 00010000:00080000:2.0:1790100345.293336:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b71f80 x1877056140934016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100345.293379:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140934016:0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.293405:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140932736:0@lo:400:kworker.0 00010000:00080000:2.0:1790100345.293423:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b71180 x1877056140933248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100345.293431:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140933248:0@lo:400:kworker.0 00000100:00100000:2.0:1790100345.293440:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140933760:0@lo:400:kworker.0 00000100:00080000:2.0:1790100345.293477:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100345.293481:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100345.293483:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790100345.293497:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fdc00 x1877056140934272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100345.293510:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140934272:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1790100345.293518:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b71c00 x1877056140933888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100345.293526:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140933888:0@lo:400:kworker.0 00002000:00000024:0.0:1790100345.294136:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100345.294182:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140933504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1344us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100345.294190:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1790100345.294217:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d16a00 x1877056140933504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100345.294232:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140933504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100345.297004:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140932992:12345-0@lo:400:kworker.0 Request processed in 4179us (4483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100345.297016:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790100345.297387:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140932992:0@lo:400:kworker.0 00010000:00010000:2.0:1790100345.672567:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790100345.755463:0:10683:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1790100346.696523:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100347.721517:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100348.364056:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140934400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100348.364119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100348.364186:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140934400 00000100:00100000:0.0:1790100348.364194:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140934400 00000100:00100000:0.0:1790100348.364237:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790100348.364245:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140934400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100348.364269:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100348.364306:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140934400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100348.364313:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790100348.364330:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790100348.364371:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b72680 x1877056140934400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100348.364388:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140934400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100348.364479:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100348.364488:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140934528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100348.364513:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100348.365000:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140934528 00000100:00100000:0.0:1790100348.365006:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140934528 00000100:00100000:0.0:1790100348.365047:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790100348.365054:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140934528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100348.365068:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100348.365102:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140934528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100348.365121:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1790100348.365147:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fdf80 x1877056140934528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100348.365160:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140934528:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790100348.365205:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790100348.745137:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100348.874331:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140934656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100348.874427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100348.874589:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140934656 00000100:00100000:1.0:1790100348.874597:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140934656 00000100:00100000:1.0:1790100348.874681:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790100348.874699:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140934656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790100348.874730:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790100348.874789:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140934656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100348.874795:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790100348.878090:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140934656:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1790100349.146822:0:10927:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing yml_node 00010000:00010000:2.0:1790100349.768838:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100349.898160:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100349.898182:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140934784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100349.898251:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100349.898318:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140934784 00000100:00100000:2.0:1790100349.898325:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140934784 00000100:00100000:2.0:1790100349.898384:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790100349.898393:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140934784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100349.898424:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100349.898464:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140934784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100349.898471:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790100349.898514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140934784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100350.301262:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100350.301458:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100350.301497:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100350.301529:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100350.301579:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127245952 00000100:00100000:3.0:1790100350.301588:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127245952 00000100:00100000:1.0:1790100350.301657:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127245568 00000100:00100000:1.0:1790100350.301663:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127245568 00000100:00100000:1.0:1790100350.301709:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:1.0:1790100350.301720:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127245568:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100350.301759:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1790100350.301770:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100350.301802:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127245568:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100350.301810:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100350.301819:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790100350.301829:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00080000:3.0:1790100350.301848:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100350.302309:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100350.302413:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127245696 00000100:00100000:0.0:1790100350.302418:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127245696 00000100:00100000:0.0:1790100350.302453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127245824 00000100:00100000:0.0:1790100350.302461:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127245824 00000100:00100000:0.0:1790100350.302483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1790100350.302491:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127245696:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100350.302659:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1790100350.302669:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245824:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100350.302729:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127246080 00000100:00100000:2.0:1790100350.302734:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127246080 00000100:00100000:2.0:1790100350.302773:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1790100350.302780:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127246080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100350.302810:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127246080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100350.302816:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00080000:2.0:1790100350.302845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100350.302849:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100350.302851:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100350.302956:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127245696:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 464us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100350.302972:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1790100350.303154:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127245824:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 486us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100350.303160:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1790100350.408715:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100350.408749:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140934912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100350.408810:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100350.409267:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140935040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100350.409327:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100350.409420:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140934912 00000100:00100000:3.0:1790100350.409427:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140934912 00000100:00100000:3.0:1790100350.409473:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140935040 00000100:00100000:3.0:1790100350.409477:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140935040 00000100:00100000:3.0:1790100350.409493:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790100350.409501:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140934912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790100350.409526:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100350.409572:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140934912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100350.409586:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790100350.409605:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100350.409617:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140935040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100350.409630:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790100350.409660:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100350.409677:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140935168:0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.409710:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790100350.409777:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fdc00 x1877056140934912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100350.409793:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140934912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100350.409821:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140935168 00000100:00100000:3.0:1790100350.409825:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140935168 00000100:00100000:3.0:1790100350.409862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790100350.409870:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140935168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.409905:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140935168:12345-0@lo:400:kworker.0 Request processed in 37us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100350.409912:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790100350.409942:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140935168:0@lo:400:kworker.0 00000100:00100000:0.0:1790100350.410225:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140935040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 612us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100350.410233:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790100350.410272:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d14a80 x1877056140935040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100350.410288:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140935040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100350.410537:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140935296:0@lo:400:kworker.0 00000100:00100000:2.0:1790100350.410545:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140935424:0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.410575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100350.410575:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140935552:0@lo:400:kworker.0 00000100:00100000:2.0:1790100350.410585:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100350.410616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100350.410625:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140935296 00000100:00100000:3.0:1790100350.410631:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140935296 00000100:00100000:2.0:1790100350.410631:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140935424 00000100:00100000:2.0:1790100350.410637:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140935424 00000100:00100000:3.0:1790100350.410660:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140935552 00000100:00100000:3.0:1790100350.410664:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140935552 00000100:00100000:2.0:1790100350.410673:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790100350.410684:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140935424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.410691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790100350.410699:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140935296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100350.410732:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140935424:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100350.410750:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790100350.410757:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140935296:12345-0@lo:400:kworker.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100350.410773:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790100350.410781:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140935552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.410783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790100350.410809:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140935680:0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.410836:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100350.410857:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140935680 00000100:00100000:3.0:1790100350.410860:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140935680 00000100:00100000:3.0:1790100350.410879:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790100350.410887:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140935680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.410922:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140935680:12345-0@lo:400:kworker.0 Request processed in 36us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100350.410929:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1790100350.410945:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100350.410953:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140936192:0@lo:400:kworker.0 00000100:00100000:2.0:1790100350.411015:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140935552:12345-0@lo:400:kworker.0 Request processed in 234us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100350.411022:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790100350.411046:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140935936:0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.411136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100350.411137:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100350.411166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140935424:0@lo:400:kworker.0 00000100:00100000:2.0:1790100350.411179:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790100350.411184:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056140935808:0@lo:400:kworker.0 00000100:00100000:2.0:1790100350.411287:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100350.411311:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140935552:0@lo:400:kworker.0 00000100:00100000:0.0:1790100350.411325:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140936064:0@lo:400:kworker.0 00000100:00100000:1.0:1790100350.411444:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140936192 00000100:00100000:1.0:1790100350.411448:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140936192 00000100:00100000:1.0:1790100350.411475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140935808 00000100:00100000:1.0:1790100350.411478:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140935808 00000100:00100000:1.0:1790100350.411493:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790100350.411499:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140936192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.413437:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140935680:0@lo:400:kworker.0 00000100:00100000:0.0:1790100350.413451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100350.413460:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140936320:0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.413495:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140935296:0@lo:400:kworker.0 00000100:00100000:0.0:1790100350.413507:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140935936 00000100:00100000:0.0:1790100350.413514:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140935936 00000100:00100000:3.0:1790100350.413532:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140936064 00000100:00100000:3.0:1790100350.413537:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140936064 00000100:00100000:0.0:1790100350.413562:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790100350.413572:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140935936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.413574:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790100350.413586:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140936064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100350.413621:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100350.413810:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140936064:12345-0@lo:400:kworker.0 Request processed in 226us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100350.413819:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790100350.413823:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63ff480 x1877056140935936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100350.413836:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140935936:0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.413857:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140936320 00000100:00100000:3.0:1790100350.413861:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140936320 00000100:00100000:3.0:1790100350.413880:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790100350.413897:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056140935808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100350.413942:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056140935808:12345-0@lo:400:kworker.0 Request processed in 44us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100350.413950:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1790100350.413951:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fd500 x1877056140935808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100350.413963:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056140935808:0@lo:400:kworker.0 00000100:00080000:2.0:1790100350.413991:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100350.413995:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100350.413997:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100350.414008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790100350.414018:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140936320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100350.414053:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140936320:12345-0@lo:400:kworker.0 Request processed in 39us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100350.414058:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1790100350.414082:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fdf80 x1877056140936320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100350.414091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140936320:0@lo:400:kworker.0 00010000:00080000:3.0:1790100350.414423:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fed80 x1877056140936064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100350.414434:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140936064:0@lo:400:kworker.0 00000100:00100000:0.0:1790100350.414593:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140935936:12345-0@lo:400:kworker.0 Request processed in 1022us (3509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100350.414602:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100350.414618:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140936192:12345-0@lo:400:kworker.0 Request processed in 3117us (3538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100350.414696:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140936192:0@lo:400:kworker.0 00000100:00100000:1.0:1790100350.415011:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:3.0:1790100350.792629:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100351.818512:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790100352.100655:0:11110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.63 00010000:00010000:2.0:1790100352.841284:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100353.484376:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140936448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100353.484437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100353.484500:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140936576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100353.484523:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100353.484553:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140936448 00000100:00100000:0.0:1790100353.484560:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140936448 00000100:00100000:0.0:1790100353.484597:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140936576 00000100:00100000:0.0:1790100353.484601:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140936576 00000100:00100000:0.0:1790100353.484616:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100353.484623:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140936448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100353.484650:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100353.484687:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140936448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100353.484695:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100353.484710:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100353.484730:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140936576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100353.485691:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100353.485819:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140936576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1088us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100353.485827:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1790100353.485855:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790100353.485885:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b71180 x1877056140936448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100353.485903:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140936448:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1790100353.486082:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b70a80 x1877056140936576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100353.486097:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140936576:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1790100353.787685:0:11207:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.63 00010000:00010000:2.0:1790100353.864496:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100353.993577:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100353.993599:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140936704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100353.994165:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100353.994374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140936704 00000100:00100000:0.0:1790100353.994383:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140936704 00000100:00100000:0.0:1790100353.994431:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100353.994440:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140936704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790100353.994476:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790100353.994536:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140936704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100353.994543:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790100353.994742:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140936704:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790100354.888688:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100355.017295:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100355.017316:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140936832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100355.017399:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100355.017558:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140936832 00000100:00100000:2.0:1790100355.017568:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140936832 00000100:00100000:2.0:1790100355.017661:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790100355.017672:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140936832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100355.017714:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100355.017766:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140936832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100355.017773:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790100355.018140:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140936832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100355.420988:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100355.421088:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100355.421117:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100355.421141:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100355.421174:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127246592 00000100:00100000:3.0:1790100355.421183:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127246592 00000100:00100000:3.0:1790100355.421243:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790100355.421253:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127246592:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100355.421321:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127246592:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100355.421328:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00080000:3.0:1790100355.421364:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100355.421734:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127246208 00000100:00100000:0.0:1790100355.421739:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127246208 00000100:00100000:0.0:1790100355.421772:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:0.0:1790100355.421780:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2422:x1877056127246208:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100355.421808:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2422:x1877056127246208:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100355.421827:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:1.0:1790100355.422089:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127246336 00000100:00100000:1.0:1790100355.422094:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127246336 00000100:00100000:1.0:1790100355.422165:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127246464 00000100:00100000:1.0:1790100355.422169:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127246464 00000100:00080000:0.0:1790100355.422190:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100355.422193:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100355.422265:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1790100355.422279:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127246336:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100355.422309:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127246336:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.422316:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1790100355.422623:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1790100355.422632:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127246464:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100355.422660:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127246464:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.422667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1790100355.426438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100355.431393:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127246720 00000100:00100000:1.0:1790100355.431407:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127246720 00000100:00100000:1.0:1790100355.431586:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00080000:2.0:1790100355.431594:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100355.431596:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127246720:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100355.431990:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127246720:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 394us (5561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.431999:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1790100355.528839:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100355.528861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140936960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100355.528930:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100355.528994:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140936960 00000100:00100000:1.0:1790100355.529001:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140936960 00000100:00100000:1.0:1790100355.529046:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790100355.529054:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140936960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100355.529093:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100355.529132:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140936960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.529145:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1790100355.529185:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fed80 x1877056140936960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100355.529203:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140936960:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790100355.530544:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100355.530971:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140937088:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.531026:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100355.531059:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140937600:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.531141:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100355.531160:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140938112:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.531181:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100355.531199:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790100355.531205:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140937216:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.531241:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100355.531260:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140937728:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.531281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100355.531297:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140938240:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.531315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100355.531464:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140937088 00000100:00100000:3.0:1790100355.531471:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140937088 00000100:00100000:2.0:1790100355.531776:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140937472:0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.531807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100355.531819:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140937984:0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.531838:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100355.531858:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790100355.531864:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140937344:0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.531885:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100355.531904:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140937856:0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.531923:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100355.531941:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140938368:0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.531966:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100355.531995:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140937984 00000100:00100000:2.0:1790100355.531999:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140937984 00000100:00100000:2.0:1790100355.532043:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140937856 00000100:00100000:2.0:1790100355.532046:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140937856 00000100:00100000:2.0:1790100355.532071:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140938368 00000100:00100000:2.0:1790100355.532074:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140938368 00000100:00100000:2.0:1790100355.532092:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100355.532100:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140937984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.532153:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140937984:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100355.532160:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100355.532176:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100355.532183:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140937856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.532213:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140937856:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100355.532218:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100355.532228:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790100355.532233:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140938368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.532256:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140938368:12345-0@lo:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100355.532262:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790100355.532279:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140937344 00000100:00100000:2.0:1790100355.532282:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140937344 00000100:00100000:2.0:1790100355.532308:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790100355.532317:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140937344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100355.532367:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140937344:12345-0@lo:400:kworker.0 Request processed in 52us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100355.532373:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1790100355.532400:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100355.532404:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100355.532430:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140937344:0@lo:400:kworker.0 00010000:00080000:2.0:1790100355.532454:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d14000 x1877056140937856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100355.532463:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140937856:0@lo:400:kworker.0 00010000:00080000:2.0:1790100355.532472:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d15500 x1877056140938368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100355.532480:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140938368:0@lo:400:kworker.0 00010000:00080000:2.0:1790100355.532677:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d17480 x1877056140937984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100355.532686:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140937984:0@lo:400:kworker.0 00000100:00100000:1.0:1790100355.532973:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140937600 00000100:00100000:1.0:1790100355.532977:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140937600 00000100:00100000:1.0:1790100355.533003:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140938112 00000100:00100000:1.0:1790100355.533006:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140938112 00000100:00100000:1.0:1790100355.533017:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140937216 00000100:00100000:1.0:1790100355.533019:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140937216 00000100:00100000:1.0:1790100355.533028:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140937728 00000100:00100000:1.0:1790100355.533031:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140937728 00000100:00100000:1.0:1790100355.533041:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140938240 00000100:00100000:1.0:1790100355.533043:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140938240 00000100:00100000:1.0:1790100355.533055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140937472 00000100:00100000:1.0:1790100355.533057:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140937472 00000100:00100000:1.0:1790100355.533068:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790100355.533074:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140937600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100355.533121:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140937600:12345-0@lo:400:kworker.0 Request processed in 48us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.533128:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790100355.533140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790100355.533147:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140938112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100355.533174:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140938112:12345-0@lo:400:kworker.0 Request processed in 28us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.533179:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790100355.533190:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790100355.533203:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140937216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100355.533235:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140937216:12345-0@lo:400:kworker.0 Request processed in 33us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.533241:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790100355.533253:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790100355.533260:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140937728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100355.533303:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140937728:12345-0@lo:400:kworker.0 Request processed in 44us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.533309:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790100355.533320:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790100355.533326:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140938240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100355.533378:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140938240:12345-0@lo:400:kworker.0 Request processed in 52us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.533385:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790100355.533396:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100355.533402:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140937472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100355.533430:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140937472:12345-0@lo:400:kworker.0 Request processed in 29us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.533435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100355.533452:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100355.533461:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140938496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100355.533504:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100355.533535:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140938496 00000100:00100000:1.0:1790100355.533539:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140938496 00000100:00100000:1.0:1790100355.533563:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790100355.533570:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140938496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790100355.533592:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100355.533627:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140938496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100355.533634:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790100355.533668:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fed80 x1877056140938496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100355.533696:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140938496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100355.534125:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140937216:0@lo:400:kworker.0 00010000:00080000:3.0:1790100355.534137:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d15f80 x1877056140937728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100355.534145:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140937728:0@lo:400:kworker.0 00010000:00080000:3.0:1790100355.534155:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d17800 x1877056140938240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100355.534162:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140938240:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.534172:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140937600:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.534194:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140938112:0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.534244:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790100355.534252:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140937088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100355.534289:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140937088:12345-0@lo:400:kworker.0 Request processed in 38us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100355.534295:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790100355.534327:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140937088:0@lo:400:kworker.0 00000100:00080000:2.0:1790100355.534505:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100355.534508:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100355.534524:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140937472:0@lo:400:kworker.0 00000001:02000400:0.0:1790100355.535838:0:11304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.63 00010000:00010000:2.0:1790100355.913710:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790100356.629101:0:11353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 22 14:05:55 EDT 2026 00010000:00010000:2.0:1790100356.938792:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100357.961702:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100358.601519:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140938624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100358.601584:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100358.602223:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140938624 00000100:00100000:3.0:1790100358.602231:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140938624 00000100:00100000:3.0:1790100358.602618:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100358.602823:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140938624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100358.602854:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100358.602911:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140938624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100358.602918:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1790100358.603947:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf6d80 x1877056140938624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100358.603974:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140938624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790100358.604554:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100358.604579:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100358.604592:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140938752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100358.604640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100358.604942:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140938752 00000100:00100000:2.0:1790100358.604948:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140938752 00000100:00100000:2.0:1790100358.605040:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790100358.605049:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140938752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790100358.605066:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100358.605110:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140938752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100358.605117:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1790100358.605152:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b70a80 x1877056140938752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100358.605181:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140938752:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790100358.605318:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790100358.984719:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100359.112995:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140938880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100359.113068:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100359.113196:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140938880 00000100:00100000:2.0:1790100359.113204:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140938880 00000100:00100000:2.0:1790100359.113252:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790100359.113261:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140938880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100359.113293:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790100359.113370:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140938880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100359.113377:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790100359.113459:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140938880:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790100360.008532:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100360.139101:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140939008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100360.139166:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100360.140873:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140939008 00000100:00100000:1.0:1790100360.140886:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140939008 00000100:00100000:1.0:1790100360.140966:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790100360.140977:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140939008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790100360.141013:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790100360.146305:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140939008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100360.146447:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140939008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5471us (7278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100360.146458:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790100360.541384:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100360.541416:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100360.541438:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100360.541460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127246848 00000100:00100000:3.0:1790100360.541469:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127246848 00000100:00100000:3.0:1790100360.541510:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:3.0:1790100360.541518:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2420:x1877056127246848:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100360.541584:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2420:x1877056127246848:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 56us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.541591:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:3.0:1790100360.541628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127246976 00000100:00100000:3.0:1790100360.541632:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127246976 00000100:00100000:3.0:1790100360.541660:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127247104 00000100:00100000:3.0:1790100360.541674:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127247104 00000100:00100000:3.0:1790100360.541694:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1790100360.541700:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2419:x1877056127246976:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100360.541729:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2419:x1877056127246976:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.541736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1790100360.541747:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1790100360.541754:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127247104:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100360.541777:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127247104:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.541782:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00080000:3.0:1790100360.541895:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790100360.541908:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100360.542264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100360.542298:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100360.542318:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127247232 00000100:00100000:3.0:1790100360.542322:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127247232 00000100:00100000:3.0:1790100360.542374:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127247360 00000100:00100000:3.0:1790100360.542377:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127247360 00000100:00100000:3.0:1790100360.542400:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1790100360.542406:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2418:x1877056127247232:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:3.0:1790100360.542430:0:8425:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a92 00000100:00080000:3.0:1790100360.542439:0:8425:0:(import.c:65:import_set_state_nolock()) ffff926083262000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790100360.542477:0:8425:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1790100360.542683:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+2:2418:x1877056127247232:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 276us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.542690:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1790100360.542702:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1790100360.542708:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2418:x1877056127247360:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:3.0:1790100360.542719:0:8425:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a99 00000100:00080000:3.0:1790100360.542726:0:8425:0:(import.c:65:import_set_state_nolock()) ffff926083160800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790100360.542747:0:8425:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1790100360.542812:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+2:2418:x1877056127247360:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 103us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.542819:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:3.0:1790100360.542839:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100360.542845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100360.542847:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790100360.544082:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100360.648503:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140939136:0@lo:400:kworker.0 00000100:00100000:2.0:1790100360.648575:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100360.648630:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140939648:0@lo:400:kworker.0 00000100:00100000:2.0:1790100360.648657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.649543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140939264:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.649610:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140939392:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.649653:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.649702:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140939904:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.649731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.649755:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140940416:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.649781:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.649810:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790100360.649819:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140939520:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.649869:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140939136 00000100:00100000:3.0:1790100360.649876:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140939136 00000100:00100000:3.0:1790100360.649916:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1790100360.649927:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140939136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.649980:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140939136:12345-0@lo:400:kworker.0 Request processed in 54us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.649988:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1790100360.650030:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140939392 00000100:00100000:3.0:1790100360.650034:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140939392 00000100:00100000:3.0:1790100360.650072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790100360.650081:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140939392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.650126:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140939392:12345-0@lo:400:kworker.0 Request processed in 47us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.650134:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790100360.650160:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140939904 00000100:00100000:3.0:1790100360.650164:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140939904 00000100:00100000:3.0:1790100360.650204:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140940416 00000100:00100000:3.0:1790100360.650207:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140940416 00000100:00100000:3.0:1790100360.650245:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100360.650255:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140939904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.650296:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140939904:12345-0@lo:400:kworker.0 Request processed in 43us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.650304:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100360.650323:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100360.650332:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140940416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.650385:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140940416:12345-0@lo:400:kworker.0 Request processed in 55us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.650392:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1790100360.650424:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100360.650429:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100360.653154:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140939648 00000100:00100000:1.0:1790100360.653165:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140939648 00000100:00100000:1.0:1790100360.653222:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790100360.653231:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140939648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.653516:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.653562:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140939776:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.653610:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.653628:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056140940288:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.653654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.653680:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140940800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100360.653705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.653725:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100360.653731:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140940672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100360.653752:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.653778:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140939264 00000100:00100000:3.0:1790100360.653782:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140939264 00000100:00100000:3.0:1790100360.653799:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140939776 00000100:00100000:3.0:1790100360.653802:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140939776 00000100:00100000:3.0:1790100360.653813:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140940288 00000100:00100000:3.0:1790100360.653828:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140940288 00000100:00100000:3.0:1790100360.653846:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790100360.653851:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140939264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.653891:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140939264:12345-0@lo:400:kworker.0 Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.653898:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790100360.653913:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790100360.653919:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140939776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.653946:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140939776:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.653952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790100360.653962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790100360.653968:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056140940288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.653995:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056140940288:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.654000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790100360.654016:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140940800 00000100:00100000:3.0:1790100360.654019:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140940800 00000100:00100000:3.0:1790100360.654034:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140940672 00000100:00100000:3.0:1790100360.654036:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140940672 00000100:00100000:3.0:1790100360.654048:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100360.654053:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140940800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790100360.654075:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100360.654104:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140940800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.654110:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100360.654120:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100360.654132:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140940672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100360.654142:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100360.654166:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140940672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.654171:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100360.654192:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.654211:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140940032:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.654234:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100360.654252:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140940544:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.654273:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100360.654410:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140939520 00000100:00100000:0.0:1790100360.654415:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140939520 00000100:00100000:0.0:1790100360.654437:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790100360.654442:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140939520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100360.654476:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140939520:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100360.654481:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1790100360.654575:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100360.654579:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100360.654581:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100360.654614:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140939392:0@lo:400:kworker.0 00010000:00080000:3.0:1790100360.654633:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf7800 x1877056140939904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100360.654644:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140939904:0@lo:400:kworker.0 00010000:00080000:3.0:1790100360.654656:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb1c00 x1877056140940416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100360.654673:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140940416:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.654695:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140939520:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.654713:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140940032 00000100:00100000:3.0:1790100360.654716:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140940032 00000100:00100000:3.0:1790100360.654788:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140940544 00000100:00100000:3.0:1790100360.654792:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140940544 00000100:00100000:3.0:1790100360.654808:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100360.654814:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140940032:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790100360.654921:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100360.655068:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140939648:12345-0@lo:400:kworker.0 Request processed in 1837us (6408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100360.655070:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140939648:0@lo:400:kworker.0 00000100:00100000:2.0:1790100360.655077:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140940160:0@lo:400:kworker.0 00000100:00100000:1.0:1790100360.655081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790100360.655102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100360.655132:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140939136:0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.656208:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140940032:12345-0@lo:400:kworker.0 Request processed in 1389us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.656218:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100360.656239:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790100360.656248:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b7be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140940544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.656284:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b7be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140940544:12345-0@lo:400:kworker.0 Request processed in 39us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.656290:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790100360.656464:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140940160 00000100:00100000:3.0:1790100360.656468:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140940160 00000100:00100000:3.0:1790100360.656507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790100360.656514:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140940160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100360.656556:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140940160:12345-0@lo:400:kworker.0 Request processed in 43us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100360.656561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1790100360.656577:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790100360.656606:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63ff480 x1877056140940672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100360.656625:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140940672:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1790100360.656650:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb0000 x1877056140940800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100360.656670:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140940800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100360.656683:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140939264:0@lo:400:kworker.0 00010000:00080000:3.0:1790100360.656692:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf5500 x1877056140939776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100360.656708:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140939776:0@lo:400:kworker.0 00010000:00080000:3.0:1790100360.656722:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb2a00 x1877056140940288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100360.656729:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056140940288:0@lo:400:kworker.0 00010000:00080000:1.0:1790100360.657521:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf7100 x1877056140940032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100360.657595:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140940032:0@lo:400:kworker.0 00010000:00080000:1.0:1790100360.657611:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb1f80 x1877056140940544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100360.657621:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140940544:0@lo:400:kworker.0 00000100:00100000:2.0:1790100360.660018:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140940160:0@lo:400:kworker.0 00010000:00010000:2.0:1790100361.032563:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100362.064571:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100363.080830:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100363.721275:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100363.721295:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140940928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100363.721416:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100363.721616:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140940928 00000100:00100000:0.0:1790100363.721623:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140940928 00000100:00100000:0.0:1790100363.721690:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790100363.721699:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140940928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100363.721725:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100363.721764:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140940928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100363.721771:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1790100363.721963:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790100363.723404:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926082133480 x1877056140940928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100363.723428:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140940928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100363.725807:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100363.725826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140941056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100363.725891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100363.725941:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140941056 00000100:00100000:0.0:1790100363.725948:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140941056 00000100:00100000:0.0:1790100363.725996:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790100363.726004:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140941056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100363.726023:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100363.726059:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140941056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100363.726065:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1790100363.726086:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790100363.726108:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926082133800 x1877056140941056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100363.726124:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140941056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790100364.106783:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100364.233538:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100364.233558:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140941184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100364.233682:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100364.233826:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140941184 00000100:00100000:2.0:1790100364.233834:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140941184 00000100:00100000:2.0:1790100364.233883:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790100364.233892:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140941184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100364.233923:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790100364.233982:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140941184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100364.233989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790100364.234064:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140941184:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790100365.129041:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100365.257437:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100365.257457:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140941312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100365.257518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100365.257638:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140941312 00000100:00100000:2.0:1790100365.257646:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140941312 00000100:00100000:2.0:1790100365.257697:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790100365.257706:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140941312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100365.257737:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100365.257783:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140941312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100365.257790:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790100365.257831:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140941312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100365.660918:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100365.661017:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100365.661065:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100365.661117:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127247488 00000100:00100000:0.0:1790100365.661127:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127247488 00000100:00100000:0.0:1790100365.661183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 277 00000100:00100000:0.0:1790100365.661193:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127247488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100365.661258:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2421:x1877056127247488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100365.661266:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 277 00000100:00100000:1.0:1790100365.662896:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127247616 00000100:00100000:1.0:1790100365.662908:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127247616 00000100:00100000:2.0:1790100365.662984:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127247744 00000100:00100000:2.0:1790100365.662989:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127247744 00000100:00080000:1.0:1790100365.663365:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790100365.663453:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:2.0:1790100365.663464:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127247744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100365.665105:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127247744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 1637us (4032us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100365.665118:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1790100365.665986:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:0.0:1790100365.665997:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127247616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100365.666069:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127247616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 74us (5159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100365.666077:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00080000:1.0:1790100365.666407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100365.769011:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100365.769032:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140941440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100365.769104:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100365.769190:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140941440 00000100:00100000:1.0:1790100365.769198:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140941440 00000100:00100000:1.0:1790100365.769250:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790100365.769259:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140941440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100365.769288:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100365.769330:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140941440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100365.769372:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1790100365.769393:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790100365.769424:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fce00 x1877056140941440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100365.769441:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140941440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100365.773967:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140941568:0@lo:400:kworker.0 00000100:00100000:0.0:1790100365.774052:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100365.774102:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140941696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100365.774185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100365.774206:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100365.774210:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140941824:0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.774285:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100365.774323:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140941568 00000100:00100000:3.0:1790100365.774329:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140941568 00000100:00100000:3.0:1790100365.774379:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790100365.774385:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140941568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100365.774953:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140941824 00000100:00100000:1.0:1790100365.774959:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140941824 00000100:00100000:1.0:1790100365.774993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790100365.775001:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140941824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100365.775050:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140941824:12345-0@lo:400:kworker.0 Request processed in 50us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100365.775057:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790100365.775110:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140941824:0@lo:400:kworker.0 00000100:00100000:1.0:1790100365.775135:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140941696 00000100:00100000:1.0:1790100365.775139:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140941696 00000100:00100000:1.0:1790100365.775189:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100365.775199:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140941696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790100365.775215:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100365.775257:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140941696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100365.775265:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1790100365.775285:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790100365.775304:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb1880 x1877056140941696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100365.775319:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140941696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100365.775681:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140941952:0@lo:400:kworker.0 00000100:00100000:1.0:1790100365.775714:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100365.775745:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140941952 00000100:00100000:1.0:1790100365.775756:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140941952 00000100:00100000:1.0:1790100365.775787:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790100365.775794:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140941952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100365.775830:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140941952:12345-0@lo:400:kworker.0 Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100365.775836:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790100365.775860:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140941952:0@lo:400:kworker.0 00000100:00100000:0.0:1790100365.780026:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140941568:0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.780550:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140941568:12345-0@lo:400:kworker.0 Request processed in 6160us (6495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100365.780562:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1790100365.781461:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100365.781590:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100365.781604:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140942336:0@lo:400:kworker.0 00000100:00100000:0.0:1790100365.781610:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140942080:0@lo:400:kworker.0 00000100:00100000:0.0:1790100365.781674:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100365.781720:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140942080 00000100:00100000:0.0:1790100365.781727:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140942080 00000100:00100000:0.0:1790100365.781768:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100365.781777:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140942080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100365.781791:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140942208:0@lo:400:kworker.0 00000100:00100000:2.0:1790100365.781817:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100365.781823:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140942080:12345-0@lo:400:kworker.0 Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100365.781829:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790100365.781848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140942208 00000100:00100000:2.0:1790100365.781851:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140942208 00000100:00100000:0.0:1790100365.781863:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140942080:0@lo:400:kworker.0 00000100:00100000:2.0:1790100365.781876:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790100365.781882:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140942208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.782245:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100365.782370:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140942720:0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.782397:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100365.782415:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100365.782420:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140942848:0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.782439:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100365.782462:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140942720 00000100:00100000:3.0:1790100365.782466:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140942720 00000100:00100000:3.0:1790100365.782512:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790100365.782519:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140942720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.782553:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140942720:12345-0@lo:400:kworker.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100365.782559:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1790100365.782578:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100365.782587:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140942336 00000100:00100000:3.0:1790100365.782590:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140942336 00000100:00100000:3.0:1790100365.782612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140942848 00000100:00100000:3.0:1790100365.782615:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140942848 00000100:00100000:1.0:1790100365.782621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100365.782674:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140942464:0@lo:400:kworker.0 00000100:00100000:0.0:1790100365.782705:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100365.782723:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140942976:0@lo:400:kworker.0 00000100:00100000:0.0:1790100365.782741:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100365.782753:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100365.782758:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140942592:0@lo:400:kworker.0 00000100:00100000:0.0:1790100365.782776:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100365.782799:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140942592 00000100:00100000:0.0:1790100365.782802:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140942592 00000100:00100000:0.0:1790100365.782828:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790100365.782834:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140942592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100365.782866:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140942592:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100365.782885:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790100365.782900:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140942208:12345-0@lo:400:kworker.0 Request processed in 1017us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100365.782904:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140942464 00000100:00100000:2.0:1790100365.782907:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790100365.782907:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140942464 00000100:00100000:2.0:1790100365.782936:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140942208:0@lo:400:kworker.0 00000100:00100000:1.0:1790100365.782937:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140942336:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1790100365.782970:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb1880 x1877056140942720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100365.782971:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140942336:12345-0@lo:400:kworker.0 Request processed in 330us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100365.782980:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140942720:0@lo:400:kworker.0 00000100:00100000:2.0:1790100365.782989:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140942336:0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.783017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140942976 00000100:00100000:3.0:1790100365.783020:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140942976 00000100:00100000:3.0:1790100365.783038:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790100365.783043:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140942848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.783104:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140942848:12345-0@lo:400:kworker.0 Request processed in 60us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100365.783110:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790100365.783121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790100365.783146:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140942976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100365.783176:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140942976:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100365.783182:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1790100365.783197:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790100365.783200:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790100365.783201:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100365.783536:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140942848:0@lo:400:kworker.0 00010000:00080000:2.0:1790100365.783570:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb0a80 x1877056140942592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100365.783581:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140942592:0@lo:400:kworker.0 00010000:00080000:2.0:1790100365.783601:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92618683c000 x1877056140942976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100365.783609:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140942976:0@lo:400:kworker.0 00000100:00100000:1.0:1790100365.784859:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790100365.784895:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790100365.784908:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140942464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100365.784978:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140942464:12345-0@lo:400:kworker.0 Request processed in 76us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100365.784985:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1790100365.785143:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb2d80 x1877056140942464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100365.785154:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140942464:0@lo:400:kworker.0 00010000:00010000:3.0:1790100366.152689:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790100366.799792:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:3.0:1790100366.799800:0:9503:0:(genops.c:885:class_export_put()) final put ffff926083165000/e84eb833-b466-4273-a7db-c12bb35adfb4 00000001:00100000:3.0:1790100366.799833:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:3.0:1790100366.799837:0:8420:0:(genops.c:885:class_export_put()) final put ffff926083260000/e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:1.0:1790100366.801828:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff926083165000/e84eb833-b466-4273-a7db-c12bb35adfb4 for lustre-OST0001 00000020:00000080:1.0:1790100366.801889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff926083260000/e84eb833-b466-4273-a7db-c12bb35adfb4 for lustre-OST0000 00000020:00000080:1.0:1790100366.801905:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083160800 for lustre-OST0001 00000020:00000080:1.0:1790100366.801909:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083262000 for lustre-OST0000 00000001:02000400:2.0:1790100367.038724:0:11981:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:06:05 (1790100365) === 00010000:00010000:0.0:1790100367.177564:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100367.460888:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100367.461215:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127247872 00000100:00100000:2.0:1790100367.461226:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127247872 00000100:00100000:2.0:1790100367.461291:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 279 00000100:00100000:2.0:1790100367.461302:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:8725:x1877056127247872:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100367.461319:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100367.461363:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926000/0xc87a4f2298286c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e04f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100367.461390:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926000/0xc87a4f2298286c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e04f expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100367.461401:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926000/0xc87a4f2298286c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e04f expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100367.461409:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926000, rc 0) 00000100:00100000:2.0:1790100367.461463:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8725:x1877056127247872:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 164us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100367.461470:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 279 00000100:00100000:2.0:1790100367.467801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100367.469594:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127248000 00000100:00100000:3.0:1790100367.469609:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127248000 00000100:00100000:3.0:1790100367.469682:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:3.0:1790100367.469693:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8725:x1877056127248000:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790100367.469850:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8725:x1877056127248000:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 160us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100367.469858:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:3.0:1790100367.476397:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100367.476531:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127248128 00000100:00100000:1.0:1790100367.476554:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127248128 00000100:00100000:1.0:1790100367.476620:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 281 00000100:00100000:1.0:1790100367.476631:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8725:x1877056127248128:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790100367.476765:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8725:x1877056127248128:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 135us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.476774:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 281 00000100:00100000:0.0:1790100367.479456:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100367.479540:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127248256 00000100:00100000:3.0:1790100367.479555:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127248256 00000100:00100000:3.0:1790100367.479607:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:3.0:1790100367.479624:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8729:x1877056127248256:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790100367.479767:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8729:x1877056127248256:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100367.479784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:0.0:1790100367.498025:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100367.498076:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127248384 00000100:00100000:2.0:1790100367.498086:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127248384 00000100:00100000:2.0:1790100367.498130:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 283 00000100:00100000:2.0:1790100367.498137:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8729:x1877056127248384:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100367.498271:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8729:x1877056127248384:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 132us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100367.498278:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 283 00000100:00100000:0.0:1790100367.504950:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100367.506097:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127248512 00000100:00100000:1.0:1790100367.506110:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127248512 00000100:00100000:1.0:1790100367.506250:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:1.0:1790100367.506262:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8729:x1877056127248512:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100367.506429:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8729:x1877056127248512:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 169us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.506436:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:0.0:1790100367.509704:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100367.509850:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127248640 00000100:00100000:2.0:1790100367.509860:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127248640 00000100:00100000:2.0:1790100367.509914:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 285 00000100:00100000:2.0:1790100367.509923:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:8725:x1877056127248640:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100367.509939:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100367.509956:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926400/0xc87a4f2298286c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e080 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100367.509982:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926400/0xc87a4f2298286c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e080 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100367.509994:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926400/0xc87a4f2298286c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e080 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100367.510003:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926400, rc 0) 00000100:00100000:2.0:1790100367.510057:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:8725:x1877056127248640:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 135us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100367.510065:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 285 00000100:00100000:0.0:1790100367.512377:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100367.512500:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127248768 00000100:00100000:1.0:1790100367.512509:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127248768 00000100:00100000:1.0:1790100367.512569:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:1.0:1790100367.512578:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:8725:x1877056127248768:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790100367.512676:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790100367.512701:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790100367.512705:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790100367.512708:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790100367.512711:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790100367.512713:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1790100367.514727:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:8725:x1877056127248768:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 2141us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.514739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:0.0:1790100367.519761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100367.519839:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127248896 00000100:00100000:3.0:1790100367.519849:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127248896 00000100:00100000:3.0:1790100367.519904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 287 00000100:00100000:3.0:1790100367.519914:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:8725:x1877056127248896:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790100367.519930:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100367.519947:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e087 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100367.519983:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100367.519995:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100367.520003:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565dc00, rc 0) 00000100:00100000:3.0:1790100367.520063:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8725:x1877056127248896:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 151us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100367.520070:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 287 00000100:00100000:0.0:1790100367.522921:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100367.523090:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127249024 00000100:00100000:1.0:1790100367.523099:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127249024 00000100:00100000:1.0:1790100367.523155:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:1.0:1790100367.523174:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8725:x1877056127249024:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790100367.523311:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8725:x1877056127249024:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 140us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.523319:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:0.0:1790100367.525318:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100367.525478:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127249152 00000100:00100000:2.0:1790100367.525487:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127249152 00000100:00100000:2.0:1790100367.525545:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 289 00000100:00100000:2.0:1790100367.525559:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8725:x1877056127249152:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790100367.525701:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8725:x1877056127249152:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 149us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100367.525708:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 289 00000100:00100000:0.0:1790100367.534657:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100367.534743:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127249280 00000100:00100000:3.0:1790100367.534752:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127249280 00000100:00100000:3.0:1790100367.534810:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:3.0:1790100367.534821:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8732:x1877056127249280:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790100367.534972:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8732:x1877056127249280:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 152us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100367.534980:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:0.0:1790100367.537130:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100367.537220:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127249408 00000100:00100000:1.0:1790100367.537228:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127249408 00000100:00100000:1.0:1790100367.537276:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 291 00000100:00100000:1.0:1790100367.537284:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8732:x1877056127249408:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100367.537459:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:8732:x1877056127249408:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 174us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.537467:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 291 00000100:00100000:0.0:1790100367.540109:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100367.540139:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100367.540167:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100367.540196:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100367.540233:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127249536 00000100:00100000:0.0:1790100367.540240:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127249536 00000100:00100000:0.0:1790100367.540265:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127250176 00000100:00100000:0.0:1790100367.540267:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127250176 00000100:00100000:0.0:1790100367.540291:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127250048 00000100:00100000:0.0:1790100367.540293:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127250048 00000100:00100000:0.0:1790100367.540301:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127249792 00000100:00100000:0.0:1790100367.540303:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127249792 00000100:00100000:0.0:1790100367.540312:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:0.0:1790100367.540320:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127250176:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100367.540413:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127250176:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 94us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100367.540424:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:0.0:1790100367.540441:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1790100367.540447:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2420:x1877056127250048:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100367.540466:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2420:x1877056127250048:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 20us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100367.540471:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1790100367.540480:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790100367.540483:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2418:x1877056127249536:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790100367.540502:0:9338:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fd276aa8-34fd-43b4-a3ff-22c247b7b6ea@192.168.203.13@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1790100367.540532:0:9338:0:(genops.c:1384:class_connect()) connect: client fd276aa8-34fd-43b4-a3ff-22c247b7b6ea, cookie 0xc87a4f2298286c52 00000100:00100000:3.0:1790100367.540680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1790100367.540685:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2418:x1877056127249792:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790100367.540699:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fd276aa8-34fd-43b4-a3ff-22c247b7b6ea@192.168.203.13@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1790100367.540718:0:6512:0:(genops.c:1384:class_connect()) connect: client fd276aa8-34fd-43b4-a3ff-22c247b7b6ea, cookie 0xc87a4f2298286c59 00000004:00100000:3.0:1790100367.540734:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790100367.540841:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9260821ba000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100367.540869:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2418:x1877056127249792:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 182us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100367.540875:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00080000:3.0:1790100367.540892:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790100367.540895:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00100000:0.0:1790100367.541481:0:9338:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790100367.541680:0:9338:0:(import.c:65:import_set_state_nolock()) ffff926083d7c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100367.541728:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2418:x1877056127249536:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 1241us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100367.541736:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790100367.548759:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100367.548949:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127250304 00000100:00100000:3.0:1790100367.548958:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127250304 00000100:00100000:3.0:1790100367.549079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1790100367.549090:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:8725:x1877056127250304:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790100367.549128:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790100367.549225:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:8725:x1877056127250304:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 137us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100367.549232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00080000:0.0:1790100367.549499:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100367.550738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100367.550776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100367.551305:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127249920 00000100:00100000:0.0:1790100367.551314:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127249920 00000100:00100000:0.0:1790100367.551402:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127249664 00000100:00100000:0.0:1790100367.551406:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127249664 00000100:00100000:0.0:1790100367.551432:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1790100367.551442:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:0:x1877056127249920:12345-192.168.203.13@tcp:41:mount.lustre.0 00000100:00100000:1.0:1790100367.551524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790100367.551535:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:0:x1877056127249664:12345-192.168.203.13@tcp:41:mount.lustre.0 00000100:00080000:3.0:1790100367.551546:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:1.0:1790100367.551563:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790100367.551645:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:0:x1877056127249664:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 113us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.551652:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000004:00000024:0.0:1790100367.551801:0:9338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790100367.551846:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:0:x1877056127249920:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 406us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100367.551853:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790100367.552716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100367.552795:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127250432 00000100:00100000:2.0:1790100367.552800:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127250432 00000100:00100000:2.0:1790100367.552865:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1790100367.552874:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:8725:x1877056127250432:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790100367.552921:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:8725:x1877056127250432:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 48us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100367.552928:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790100367.554680:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100367.554713:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100367.554748:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100367.554815:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127250560 00000100:00100000:1.0:1790100367.554824:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127250560 00000100:00100000:1.0:1790100367.554859:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127250688 00000100:00100000:1.0:1790100367.554862:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127250688 00000100:00100000:1.0:1790100367.554878:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790100367.554910:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2418:x1877056127250560:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790100367.554938:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fd276aa8-34fd-43b4-a3ff-22c247b7b6ea@192.168.203.13@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1790100367.554966:0:8427:0:(genops.c:1384:class_connect()) connect: client fd276aa8-34fd-43b4-a3ff-22c247b7b6ea, cookie 0xc87a4f2298286c60 00002000:00100000:1.0:1790100367.554977:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fd276aa8-34fd-43b4-a3ff-22c247b7b6ea/ffff926083160800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790100367.554994:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790100367.555066:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790100367.555096:0:8427:0:(import.c:65:import_set_state_nolock()) ffff926083160000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100367.555150:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2418:x1877056127250560:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 250us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.555296:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1790100367.555365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127250816 00000100:00100000:2.0:1790100367.555371:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127250816 00000100:00100000:2.0:1790100367.555401:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1790100367.555409:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:8725:x1877056127250816:12345-192.168.203.13@tcp:900:mount.lustre.0 00000100:00100000:2.0:1790100367.555444:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:8725:x1877056127250816:12345-192.168.203.13@tcp:900:mount.lustre.0 Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100367.555450:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1790100367.555734:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790100367.555740:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2418:x1877056127250688:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790100367.556009:0:8426:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fd276aa8-34fd-43b4-a3ff-22c247b7b6ea@192.168.203.13@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1790100367.556029:0:8426:0:(genops.c:1384:class_connect()) connect: client fd276aa8-34fd-43b4-a3ff-22c247b7b6ea, cookie 0xc87a4f2298286c67 00002000:00100000:0.0:1790100367.556035:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fd276aa8-34fd-43b4-a3ff-22c247b7b6ea/ffff926083d7f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790100367.556042:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790100367.556083:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790100367.556098:0:8426:0:(import.c:65:import_set_state_nolock()) ffff926083d79800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100367.556121:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2418:x1877056127250688:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 381us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100367.556128:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1790100367.557665:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100367.557845:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127250944 00000100:00100000:0.0:1790100367.557852:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127250944 00000100:00100000:0.0:1790100367.557893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1790100367.557909:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:8725:x1877056127250944:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790100367.557979:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790100367.558072:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:8725:x1877056127250944:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 170us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100367.558090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00010000:00010000:3.0:1790100368.205634:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100368.840827:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100368.840849:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140943104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100368.840916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100368.841116:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140943104 00000100:00100000:0.0:1790100368.841182:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140943104 00000100:00080000:3.0:1790100368.841232:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100368.841239:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790100368.841249:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140943104:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100368.841668:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140943232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100368.841702:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100368.842204:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1790100368.842213:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1790100368.843000:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100368.843172:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140943104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1923us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100368.843189:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790100368.843212:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140943232 00000100:00100000:2.0:1790100368.843217:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140943232 00010000:00080000:0.0:1790100368.843225:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c1b42d80 x1877056140943104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100368.843248:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140943104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100368.843262:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790100368.843270:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140943232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100368.843285:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100368.843322:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140943232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100368.843328:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1790100368.843813:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083285880 x1877056140943232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100368.843827:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140943232:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790100368.844154:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100369.224535:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100369.353266:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140943360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100369.353477:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100369.353614:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140943360 00000100:00100000:2.0:1790100369.353623:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140943360 00000100:00100000:2.0:1790100369.353678:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790100369.353687:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140943360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100369.353717:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790100369.353770:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140943360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100369.353778:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790100369.362155:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140943360:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790100370.248641:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100370.376621:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140943488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100370.376689:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100370.376759:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140943488 00000100:00100000:3.0:1790100370.376768:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140943488 00000100:00100000:3.0:1790100370.376817:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790100370.376827:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140943488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790100370.376857:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790100370.380080:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140943488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3245us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100370.380094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790100370.380588:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140943488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100370.889558:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140943744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100370.889639:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100370.889679:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140943616:0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.889712:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140944256:0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.889726:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100370.889794:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140944000:0@lo:400:kworker.0 00000100:00100000:3.0:1790100370.890524:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140943872:0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.896039:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100370.896106:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140944768:0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.896153:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100370.896173:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140945280:0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.896189:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100370.896247:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140943744 00000100:00100000:2.0:1790100370.896255:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140943744 00000100:00100000:2.0:1790100370.896301:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100370.896309:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140943744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100370.896354:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100370.896391:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140943744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (6755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.896398:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100370.896419:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140943616 00000100:00100000:2.0:1790100370.896423:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140943616 00000100:00100000:2.0:1790100370.896442:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1790100370.896448:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140943616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.896473:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140943616:12345-0@lo:400:kworker.0 Request processed in 25us (6749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.896478:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1790100370.896498:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140944256 00000100:00100000:2.0:1790100370.896501:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140944256 00000100:00100000:2.0:1790100370.896520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790100370.896525:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140944256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.896549:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140944256:12345-0@lo:400:kworker.0 Request processed in 24us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.896554:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790100370.896567:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140944768 00000100:00100000:2.0:1790100370.896569:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140944768 00000100:00100000:2.0:1790100370.896600:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140945280 00000100:00100000:2.0:1790100370.896603:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140945280 00000100:00100000:2.0:1790100370.896621:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790100370.896626:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140944768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.898268:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140944768:12345-0@lo:400:kworker.0 Request processed in 1634us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.898280:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790100370.898308:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790100370.898320:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140945280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.898369:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140945280:12345-0@lo:400:kworker.0 Request processed in 54us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.898375:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790100370.898455:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140944256:0@lo:400:kworker.0 00010000:00080000:2.0:1790100370.898470:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd3100 x1877056140944768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100370.898480:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140944768:0@lo:400:kworker.0 00010000:00080000:2.0:1790100370.898491:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd0e00 x1877056140945280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100370.898499:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140945280:0@lo:400:kworker.0 00010000:00080000:2.0:1790100370.898510:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d68000 x1877056140943744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100370.898525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140943744:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790100370.898577:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100370.898582:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100370.898963:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140943616:0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.898974:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140944128:0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.899011:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100370.899035:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140944640:0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.899058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100370.899076:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140945152:0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.899095:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100370.899525:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140944640 00000100:00100000:1.0:1790100370.899532:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140944640 00000100:00100000:1.0:1790100370.899574:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140945152 00000100:00100000:1.0:1790100370.899600:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140945152 00000100:00100000:1.0:1790100370.899627:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790100370.899635:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140944640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.899677:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140944640:12345-0@lo:400:kworker.0 Request processed in 43us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100370.899683:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790100370.899696:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790100370.899701:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140945152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.899723:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140945152:12345-0@lo:400:kworker.0 Request processed in 22us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100370.899728:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1790100370.899745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100370.899747:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790100370.899766:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd3800 x1877056140944640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100370.899776:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140944640:0@lo:400:kworker.0 00010000:00080000:1.0:1790100370.899785:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd0380 x1877056140945152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100370.899793:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140945152:0@lo:400:kworker.0 00000100:00100000:0.0:1790100370.899880:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100370.899919:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140944512:0@lo:400:kworker.0 00000100:00100000:0.0:1790100370.899944:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100370.899967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140944128 00000100:00100000:0.0:1790100370.899970:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140944128 00000100:00100000:0.0:1790100370.900003:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140944512 00000100:00100000:0.0:1790100370.900006:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140944512 00000100:00100000:0.0:1790100370.900029:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790100370.900035:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140944128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100370.900069:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140944128:12345-0@lo:400:kworker.0 Request processed in 35us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100370.900075:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790100370.900088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790100370.900094:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140944512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.900367:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140944000 00000100:00100000:1.0:1790100370.900371:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140944000 00000100:00100000:1.0:1790100370.900397:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790100370.900404:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140944000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.900441:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140944000:12345-0@lo:400:kworker.0 Request processed in 38us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100370.900446:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790100370.900485:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140944128:0@lo:400:kworker.0 00000100:00080000:2.0:1790100370.900522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100370.900530:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140945024:0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.900557:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100370.900605:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140944000:0@lo:400:kworker.0 00000100:00100000:1.0:1790100370.900630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140945024 00000100:00100000:1.0:1790100370.900633:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140945024 00000100:00100000:1.0:1790100370.900663:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790100370.900668:0:9338:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790100370.900672:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140945024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.900680:0:9338:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1790100370.900711:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140945024:12345-0@lo:400:kworker.0 Request processed in 41us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100370.900717:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1790100370.900747:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd2300 x1877056140945024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100370.900758:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140945024:0@lo:400:kworker.0 00000100:00080000:2.0:1790100370.900763:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100370.900905:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140944512:12345-0@lo:400:kworker.0 Request processed in 810us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100370.900912:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1790100370.907584:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd1500 x1877056140944512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100370.907611:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140944512:0@lo:400:kworker.0 00000100:00100000:3.0:1790100370.907702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100370.907751:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140944384:0@lo:400:kworker.0 00000100:00100000:3.0:1790100370.907784:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100370.907815:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140944896:0@lo:400:kworker.0 00000100:00100000:3.0:1790100370.907835:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100370.907860:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140945408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100370.907883:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100370.908018:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140943872 00000100:00100000:2.0:1790100370.908025:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140943872 00000100:00100000:2.0:1790100370.908071:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140944384 00000100:00100000:2.0:1790100370.908074:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140944384 00000100:00100000:2.0:1790100370.908095:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140944896 00000100:00100000:2.0:1790100370.908098:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140944896 00000100:00100000:2.0:1790100370.908122:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790100370.908129:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140943872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.908179:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140943872:12345-0@lo:400:kworker.0 Request processed in 51us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.908186:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790100370.908202:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790100370.908208:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140944384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.908254:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140944384:12345-0@lo:400:kworker.0 Request processed in 47us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.908260:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790100370.908271:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790100370.908277:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140944896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100370.908301:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140944896:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.908306:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790100370.908322:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140945408 00000100:00100000:2.0:1790100370.908326:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140945408 00000100:00100000:2.0:1790100370.908369:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100370.908376:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140945408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790100370.908390:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100370.908419:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140945408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100370.908439:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1790100370.908468:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100370.909065:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140943872:0@lo:400:kworker.0 00000100:00100000:3.0:1790100370.909077:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140944384:0@lo:400:kworker.0 00000100:00100000:3.0:1790100370.909086:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140944896:0@lo:400:kworker.0 00010000:00080000:3.0:1790100370.909096:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083284a80 x1877056140945408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100370.909137:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140945408:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1790100371.272642:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790100371.834660:0:12176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1790100372.296504:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100372.825474:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100372.825621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100372.830882:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100372.830914:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100372.830938:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100372.831476:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127251200 00000100:00100000:0.0:1790100372.831486:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127251200 00000100:00100000:0.0:1790100372.831561:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127251456 00000100:00100000:0.0:1790100372.831565:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127251456 00000100:00100000:0.0:1790100372.831599:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1790100372.831607:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127251200:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100372.831674:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127251200:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (6207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100372.831681:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1790100372.831697:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:0.0:1790100372.831703:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2422:x1877056127251456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100372.831727:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2422:x1877056127251456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (6106us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100372.831733:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:0.0:1790100372.832331:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127251712 00000100:00100000:0.0:1790100372.832336:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127251712 00000100:00100000:0.0:1790100372.832396:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1790100372.832404:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2422:x1877056127251712:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100372.832435:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2422:x1877056127251712:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100372.832441:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1790100372.832471:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127251072 00000100:00100000:0.0:1790100372.832475:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127251072 00000100:00100000:0.0:1790100372.832499:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 293 00000100:00100000:0.0:1790100372.832505:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127251072:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100372.832530:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127251072:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100372.832536:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 293 00000100:00080000:3.0:1790100372.832704:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790100372.832709:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100372.833128:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100372.833164:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100372.833187:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127251840 00000100:00100000:1.0:1790100372.833191:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127251840 00000100:00100000:1.0:1790100372.833225:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1790100372.833231:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2422:x1877056127251840:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100372.833268:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2422:x1877056127251840:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100372.833275:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1790100372.833480:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127251328 00000100:00100000:3.0:1790100372.833485:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127251328 00000100:00080000:1.0:1790100372.833645:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100372.833649:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100372.833939:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127251584 00000100:00100000:0.0:1790100372.833946:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127251584 00000100:00080000:1.0:1790100372.833988:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100372.833997:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1790100372.834016:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2422:x1877056127251584:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100372.834071:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2422:x1877056127251584:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 55us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100372.834078:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:3.0:1790100372.834129:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1790100372.834138:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127251328:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100372.834165:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127251328:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100372.834172:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00010000:00010000:0.0:1790100373.321270:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790100373.454654:0:7441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000001:00100000:0.0:1790100373.454801:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000001:00100000:1.0:1790100373.455036:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000001:00100000:0.0:1790100373.459298:0:6492:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000100:00100000:1.0:1790100373.961439:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140945536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100373.961502:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100373.961692:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140945536 00000100:00100000:0.0:1790100373.961700:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140945536 00000100:00100000:0.0:1790100373.961772:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790100373.961781:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140945536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100373.961806:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100373.961846:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140945536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100373.961852:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1790100373.961999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790100373.962028:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c1b41880 x1877056140945536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100373.962047:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140945536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100373.962912:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140945664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100373.962948:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100373.963025:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140945664 00000100:00100000:3.0:1790100373.963030:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140945664 00000100:00100000:3.0:1790100373.963074:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100373.963080:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140945664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100373.963093:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100373.963126:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140945664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100373.963132:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1790100373.963158:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c3100 x1877056140945664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100373.963170:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140945664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790100373.963289:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790100374.348051:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100374.476905:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140945792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100374.477038:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100374.477130:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140945792 00000100:00100000:3.0:1790100374.477137:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140945792 00000100:00100000:3.0:1790100374.477181:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790100374.477191:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140945792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100374.477220:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790100374.477263:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140945792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100374.477269:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790100374.477308:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140945792:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790100375.373447:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100375.499053:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140945920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100375.499131:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100375.499192:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140945920 00000100:00100000:1.0:1790100375.499200:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140945920 00000100:00100000:1.0:1790100375.499250:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100375.499259:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140945920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790100375.499290:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790100375.499393:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140945920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100375.499400:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790100375.499475:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140945920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100376.008681:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100376.008702:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140946048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100376.008820:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100376.008913:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140946048 00000100:00100000:1.0:1790100376.008920:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140946048 00000100:00100000:1.0:1790100376.008969:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790100376.008977:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140946048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790100376.009004:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100376.009046:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140946048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100376.009053:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1790100376.009074:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790100376.009100:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c1500 x1877056140946048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100376.009122:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140946048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100376.009775:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140946304:0@lo:400:kworker.0 00000100:00100000:2.0:1790100376.009854:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100376.009879:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140946816:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.009994:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140946432:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010027:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010047:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140946944:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010065:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010081:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056140947456:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010131:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140946432 00000100:00100000:3.0:1790100376.010136:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140946432 00000100:00100000:3.0:1790100376.010168:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790100376.010175:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140946432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010226:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140946432:12345-0@lo:400:kworker.0 Request processed in 51us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.010247:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790100376.010266:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140946304 00000100:00100000:3.0:1790100376.010270:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140946304 00000100:00100000:3.0:1790100376.010292:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140946944 00000100:00100000:3.0:1790100376.010295:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140946944 00000100:00100000:3.0:1790100376.010318:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140947456 00000100:00100000:3.0:1790100376.010321:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140947456 00000100:00100000:3.0:1790100376.010335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790100376.010377:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140946304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010409:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140946304:12345-0@lo:400:kworker.0 Request processed in 34us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.010416:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790100376.010428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790100376.010434:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140946944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010459:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140946944:12345-0@lo:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.010465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790100376.010475:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790100376.010481:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056140947456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010505:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056140947456:12345-0@lo:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.010510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1790100376.010533:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790100376.010565:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140946432:0@lo:400:kworker.0 00010000:00080000:3.0:1790100376.010577:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bb1880 x1877056140946944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100376.010598:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140946944:0@lo:400:kworker.0 00010000:00080000:3.0:1790100376.010609:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b71500 x1877056140947456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100376.010617:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056140947456:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010641:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140946176:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010669:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010694:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140946688:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010712:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010727:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140947200:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010745:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010762:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790100376.010767:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140946560:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010785:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010798:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140947072:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010815:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010830:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140947584:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.010846:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100376.010868:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140947200 00000100:00100000:3.0:1790100376.010872:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140947200 00000100:00100000:2.0:1790100376.011750:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100376.011787:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140947328:0@lo:400:kworker.0 00000100:00100000:2.0:1790100376.011811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100376.011856:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140946304:0@lo:400:kworker.0 00000100:00100000:2.0:1790100376.011882:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140946560 00000100:00100000:2.0:1790100376.011886:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140946560 00000100:00100000:1.0:1790100376.012091:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100376.012100:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140947712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100376.012129:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100376.012161:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140947712 00000100:00100000:1.0:1790100376.012165:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140947712 00000100:00100000:1.0:1790100376.012258:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790100376.012267:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140947712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100376.012286:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100376.012323:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140947712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.012459:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140947072 00000100:00100000:3.0:1790100376.012464:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140947072 00000100:00100000:3.0:1790100376.012483:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140947584 00000100:00100000:3.0:1790100376.012496:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140947584 00000100:00100000:3.0:1790100376.012509:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100376.012522:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140947200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.012570:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140947200:12345-0@lo:400:kworker.0 Request processed in 48us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.012577:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100376.012592:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790100376.012598:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140947072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.012624:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140947072:12345-0@lo:400:kworker.0 Request processed in 26us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.012629:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790100376.012638:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790100376.012644:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1877056140947584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.012666:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1877056140947584:12345-0@lo:400:kworker.0 Request processed in 23us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.012672:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1790100376.012697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100376.012701:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100376.012709:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140946816 00000100:00100000:3.0:1790100376.012712:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140946816 00000100:00100000:0.0:1790100376.012765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140947328 00000100:00100000:0.0:1790100376.012769:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140947328 00000100:00100000:2.0:1790100376.012821:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790100376.012847:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1790100376.012877:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd3b80 x1877056140947712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100376.012906:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140947712:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790100376.012937:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b73b80 x1877056140947072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100376.012947:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140947072:0@lo:400:kworker.0 00010000:00080000:1.0:1790100376.012957:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b70a80 x1877056140947584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100376.012965:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140947584:0@lo:400:kworker.0 00010000:00080000:1.0:1790100376.012974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b70700 x1877056140947200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100376.012982:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140947200:0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.013058:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790100376.013065:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140946816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.013103:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140946816:12345-0@lo:400:kworker.0 Request processed in 39us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.013108:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790100376.013153:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140946688 00000100:00100000:3.0:1790100376.013157:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140946688 00000100:00100000:3.0:1790100376.013179:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790100376.013185:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140946688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.013242:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140946688:12345-0@lo:400:kworker.0 Request processed in 57us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.013248:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790100376.013268:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140946176 00000100:00100000:3.0:1790100376.013271:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140946176 00000100:00100000:3.0:1790100376.013297:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1790100376.013303:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140946176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.013333:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140946176:12345-0@lo:400:kworker.0 Request processed in 31us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.013367:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1790100376.013428:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140946816:0@lo:400:kworker.0 00000100:00080000:1.0:1790100376.014091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100376.014115:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140946176:0@lo:400:kworker.0 00000100:00100000:1.0:1790100376.014129:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140946688:0@lo:400:kworker.0 00000100:00080000:1.0:1790100376.014480:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100376.014621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790100376.014631:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140947328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.014688:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140947328:12345-0@lo:400:kworker.0 Request processed in 60us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.014695:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790100376.014770:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140947328:0@lo:400:kworker.0 00000100:00100000:2.0:1790100376.014971:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140946560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100376.015126:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140946560:12345-0@lo:400:kworker.0 Request processed in 2297us (4339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100376.015133:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790100376.015259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140946560:0@lo:400:kworker.0 00010000:00010000:0.0:1790100376.393044:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790100377.360215:0:12492:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100377.360625:0:12492:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100377.417143:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100377.945001:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100377.945056:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100377.945090:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100377.945112:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100377.945132:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100377.945149:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100377.945175:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100377.945203:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127252224 00000100:00100000:2.0:1790100377.945223:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127252224 00000100:00100000:2.0:1790100377.945275:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127252480 00000100:00100000:2.0:1790100377.945284:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127252480 00000100:00100000:2.0:1790100377.945302:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127252096 00000100:00100000:2.0:1790100377.945304:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127252096 00000100:00100000:2.0:1790100377.945314:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127252352 00000100:00100000:2.0:1790100377.945317:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127252352 00000100:00100000:2.0:1790100377.945331:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:2.0:1790100377.945358:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127252224:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100377.945424:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127252224:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100377.945431:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:2.0:1790100377.945447:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:2.0:1790100377.945452:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127252480:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100377.945546:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127252480:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100377.945555:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:2.0:1790100377.945569:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:2.0:1790100377.945575:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127252096:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100377.945672:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127252096:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 96us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100377.945679:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:2.0:1790100377.945691:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:2.0:1790100377.945697:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127252352:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100377.945721:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127252352:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100377.945727:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:2.0:1790100377.945756:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127252736 00000100:00100000:2.0:1790100377.945760:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127252736 00000100:00100000:2.0:1790100377.945783:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127252608 00000100:00100000:2.0:1790100377.945787:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127252608 00000100:00100000:2.0:1790100377.945805:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790100377.945812:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127252736:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100377.945837:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127252736:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100377.945843:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790100377.945854:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1790100377.945860:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127252608:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100377.945882:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127252608:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100377.945887:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00080000:2.0:1790100377.945906:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100377.945910:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100377.945913:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100377.945914:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790100377.948950:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127251968 00000100:00100000:2.0:1790100377.948965:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127251968 00000100:00100000:2.0:1790100377.949037:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 295 00000100:00100000:2.0:1790100377.949047:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127251968:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100377.949127:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127251968:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 82us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100377.949135:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 295 00010000:00010000:3.0:1790100378.441779:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790100378.742929:0:12589:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790100378.743153:0:12589:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790100379.080610:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140947840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100379.080689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100379.080807:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140947840 00000100:00100000:2.0:1790100379.080815:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140947840 00000100:00100000:2.0:1790100379.080885:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790100379.080893:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140947840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100379.080918:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100379.081419:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140947968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100379.081452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100379.081601:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140947968 00000100:00100000:3.0:1790100379.081606:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140947968 00000100:00100000:3.0:1790100379.081632:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790100379.081640:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140947968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100379.081723:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100379.081848:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140947968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 209us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100379.081856:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790100379.081939:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140947840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1047us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100379.081946:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1790100379.081965:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790100379.082187:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf5880 x1877056140947968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100379.082204:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140947968:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1790100379.082286:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf5500 x1877056140947840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100379.082300:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140947840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100379.465714:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100379.595300:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140948096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100379.595399:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100379.595484:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140948096 00000100:00100000:0.0:1790100379.595492:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140948096 00000100:00100000:0.0:1790100379.595545:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790100379.595554:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140948096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790100379.595586:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790100379.595630:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140948096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100379.595637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790100379.595692:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140948096:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1790100380.143753:0:12686:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790100380.143948:0:12686:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100380.489465:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100380.618324:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100380.618565:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140948224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100380.618620:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100380.619834:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140948224 00000100:00100000:1.0:1790100380.619844:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140948224 00000100:00100000:1.0:1790100380.619912:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790100380.619922:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140948224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790100380.619955:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790100380.620225:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140948224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 302us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100380.620232:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790100380.620307:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140948224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100381.128850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140948736:0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.128899:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140948480:0@lo:400:kworker.0 00000100:00100000:0.0:1790100381.128916:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100381.128930:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140948608:0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.128955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100381.129127:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140948736 00000100:00100000:2.0:1790100381.129128:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140948352:0@lo:400:kworker.0 00000100:00100000:1.0:1790100381.129135:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140948736 00000100:00100000:1.0:1790100381.129188:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790100381.129196:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140948736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100381.129253:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140948736:12345-0@lo:400:kworker.0 Request processed in 58us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100381.129260:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790100381.129332:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100381.129434:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100381.130252:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140948480 00000100:00100000:3.0:1790100381.130259:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140948608 00000100:00100000:2.0:1790100381.130261:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140948480 00000100:00100000:3.0:1790100381.130265:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140948608 00000100:00100000:2.0:1790100381.130310:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790100381.130313:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790100381.130323:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140948480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.130327:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140948608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100381.130453:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140948352 00000100:00100000:1.0:1790100381.130458:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140948352 00000100:00100000:1.0:1790100381.130488:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790100381.130495:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140948352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100381.130655:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140948736:0@lo:400:kworker.0 00000100:00100000:0.0:1790100381.130665:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140949248:0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.130922:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140948608:12345-0@lo:400:kworker.0 Request processed in 598us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100381.130924:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056140948480:12345-0@lo:400:kworker.0 Request processed in 602us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.130934:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790100381.130939:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790100381.130984:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140948608:0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.130994:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140949120:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.131011:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056140948480:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.131031:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140948992:0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.131032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100381.131070:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140949632:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.131071:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100381.131102:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140949504:0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.131114:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100381.131132:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100381.131165:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140950144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100381.131209:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100381.131240:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140949120 00000100:00100000:3.0:1790100381.131244:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140949120 00000100:00100000:3.0:1790100381.131282:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140948992 00000100:00100000:3.0:1790100381.131285:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140948992 00000100:00100000:3.0:1790100381.131297:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140949632 00000100:00100000:3.0:1790100381.131300:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140949632 00000100:00100000:3.0:1790100381.131310:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140949504 00000100:00100000:3.0:1790100381.131313:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140949504 00000100:00100000:3.0:1790100381.131325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790100381.131331:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140949120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.131387:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140949120:12345-0@lo:400:kworker.0 Request processed in 56us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.131394:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790100381.131405:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790100381.131421:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140948992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.131451:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140948992:12345-0@lo:400:kworker.0 Request processed in 40us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.131457:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790100381.131468:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790100381.131484:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140949632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.131526:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140949632:12345-0@lo:400:kworker.0 Request processed in 50us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.131532:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790100381.131548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790100381.131561:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140948352:12345-0@lo:400:kworker.0 Request processed in 1065us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.131580:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140949504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100381.131581:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1790100381.131622:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140949504:12345-0@lo:400:kworker.0 Request processed in 67us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.131635:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790100381.131656:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140950144 00000100:00100000:3.0:1790100381.131659:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140950144 00000100:00100000:3.0:1790100381.131685:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790100381.131691:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140950144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790100381.131713:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100381.131743:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140950144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.131749:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1790100381.131764:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100381.131769:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790100381.131771:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790100381.131800:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d14000 x1877056140950144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100381.131816:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140950144:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1790100381.131827:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb2d80 x1877056140949120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100381.131835:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140949120:0@lo:400:kworker.0 00010000:00080000:3.0:1790100381.131845:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb1500 x1877056140949632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100381.131852:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140949632:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133021:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140950016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100381.133095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100381.133173:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140948992:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133186:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140949504:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133245:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140948352:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133254:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140948864:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100381.133357:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140949376:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133380:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100381.133408:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140949888:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133426:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100381.133461:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140949376 00000100:00100000:2.0:1790100381.133468:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140949376 00000100:00100000:2.0:1790100381.133506:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140949888 00000100:00100000:2.0:1790100381.133509:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140949888 00000100:00100000:2.0:1790100381.133545:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100381.133552:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140949376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133613:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140949376:12345-0@lo:400:kworker.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100381.133619:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100381.133636:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100381.133641:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140949888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.133665:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140949888:12345-0@lo:400:kworker.0 Request processed in 24us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100381.133669:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1790100381.133695:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb2300 x1877056140949376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100381.133719:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140949376:0@lo:400:kworker.0 00010000:00080000:2.0:1790100381.133730:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb2680 x1877056140949888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100381.133737:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140949888:0@lo:400:kworker.0 00000100:00100000:1.0:1790100381.134556:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140950016 00000100:00100000:1.0:1790100381.134565:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140950016 00000100:00100000:1.0:1790100381.134616:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790100381.134793:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140950016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100381.134815:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100381.134879:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140950016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100381.134886:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1790100381.135576:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd0e00 x1877056140950016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100381.135595:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140950016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100381.136305:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100381.136363:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140949760:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.136730:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140949248 00000100:00100000:2.0:1790100381.136738:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140949248 00000100:00100000:2.0:1790100381.136789:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790100381.136798:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140949248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.136852:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140949248:12345-0@lo:400:kworker.0 Request processed in 55us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100381.136859:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790100381.136943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790100381.136992:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb0380 x1877056140949248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100381.137004:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140949248:0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.137257:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140949760 00000100:00100000:2.0:1790100381.137262:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140949760 00000100:00100000:2.0:1790100381.137295:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790100381.137301:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140949760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100381.137677:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140949760:12345-0@lo:400:kworker.0 Request processed in 374us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.137685:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140948864 00000100:00100000:2.0:1790100381.137686:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100381.137694:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140948864 00000100:00080000:2.0:1790100381.137731:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100381.137735:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1790100381.137736:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100381.137747:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140948864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100381.137816:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140948864:12345-0@lo:400:kworker.0 Request processed in 72us (4505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100381.137823:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790100381.139582:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140948864:0@lo:400:kworker.0 00010000:00080000:1.0:1790100381.140949:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb1180 x1877056140949760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100381.140965:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140949760:0@lo:400:kworker.0 00010000:00010000:3.0:1790100381.513580:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790100381.870878:0:12783:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100381.874924:0:12783:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100382.536469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100383.064142:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100383.064221:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100383.064259:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100383.064305:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100383.064325:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100383.064359:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100383.064387:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100383.064412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127253120 00000100:00100000:2.0:1790100383.064421:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127253120 00000100:00100000:1.0:1790100383.064630:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127253376 00000100:00100000:1.0:1790100383.064635:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127253376 00000100:00100000:1.0:1790100383.064687:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127252992 00000100:00100000:1.0:1790100383.064690:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127252992 00000100:00100000:1.0:1790100383.064703:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127253248 00000100:00100000:1.0:1790100383.064706:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127253248 00000100:00100000:1.0:1790100383.064721:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:1.0:1790100383.064730:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127253376:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100383.064801:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127253376:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100383.064818:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:1.0:1790100383.064837:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1790100383.064845:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127252992:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100383.064861:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:2.0:1790100383.064871:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127253248:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100383.064877:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127252992:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100383.064885:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1790100383.064905:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1790100383.064910:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127253248:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100383.064918:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127253120:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100383.064922:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:2.0:1790100383.064947:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127253632 00000100:00100000:2.0:1790100383.064951:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127253632 00000100:00100000:1.0:1790100383.064955:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127253120:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 38us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100383.064963:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1790100383.064978:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127253504 00000100:00100000:2.0:1790100383.064981:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127253504 00000100:00100000:2.0:1790100383.065009:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1790100383.065017:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127253632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100383.065044:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127253632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100383.065050:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1790100383.065065:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1790100383.065073:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127253504:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100383.065098:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127253504:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100383.065103:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00080000:2.0:1790100383.065128:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100383.065137:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100383.065141:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100383.065143:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100383.065529:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127252864 00000100:00100000:0.0:1790100383.065536:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127252864 00000100:00100000:0.0:1790100383.065582:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 297 00000100:00100000:0.0:1790100383.065590:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127252864:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100383.065620:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127252864:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100383.065640:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 297 00000020:00000004:1.0:1790100383.383520:0:12880:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100383.383815:0:12880:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100383.560735:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100384.201599:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100384.201620:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140950272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100384.201892:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100384.201903:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140950400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100384.201928:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100384.202180:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140950272 00000100:00100000:3.0:1790100384.202188:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140950272 00000100:00100000:3.0:1790100384.202263:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790100384.202275:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140950272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100384.202304:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100384.202380:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140950272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100384.202387:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1790100384.202405:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100384.202420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100384.202499:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140950400 00000100:00100000:1.0:1790100384.202504:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140950400 00000100:00100000:1.0:1790100384.202533:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790100384.202539:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140950400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100384.202550:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1790100384.203241:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf7800 x1877056140950272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100384.203272:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140950272:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790100384.204384:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100384.205094:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140950400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2549us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100384.205107:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1790100384.205185:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ed8700 x1877056140950400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100384.205208:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140950400:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100384.587598:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100384.718285:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100384.718305:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140950528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100384.718375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100384.718438:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140950528 00000100:00100000:3.0:1790100384.718444:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140950528 00000100:00100000:3.0:1790100384.718482:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100384.718501:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140950528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100384.718531:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790100384.718569:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140950528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100384.718576:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100384.718613:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140950528:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790100385.611017:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100385.736553:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100385.736582:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140950656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100385.736668:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100385.737042:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140950656 00000100:00100000:0.0:1790100385.737053:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140950656 00000100:00100000:0.0:1790100385.737127:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790100385.737138:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140950656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790100385.737189:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790100385.737274:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140950656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100385.737281:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790100385.737540:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140950656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100386.249316:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100386.249582:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140950784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100386.249648:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.249794:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140950784 00000100:00100000:0.0:1790100386.249801:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140950784 00000100:00100000:0.0:1790100386.249849:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790100386.249859:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140950784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100386.249885:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100386.249921:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140950784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.249928:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790100386.249951:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140950912:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.249978:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.249999:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140951424:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.250021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.250038:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140951936:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.250057:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.250074:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790100386.250080:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140951040:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.250098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.250114:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140951552:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.250131:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.250146:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140952064:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.250176:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790100386.250203:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100386.250217:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140950912 00000100:00100000:0.0:1790100386.250221:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140950912 00000100:00100000:0.0:1790100386.250247:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790100386.250254:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140950912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.250288:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140950912:12345-0@lo:400:kworker.0 Request processed in 35us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.250294:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790100386.250320:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140951424 00000100:00100000:0.0:1790100386.250324:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140951424 00000100:00100000:3.0:1790100386.250602:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140951296:0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.250634:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.250648:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140951808:0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.250669:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.250690:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790100386.250696:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140951168:0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.250717:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.250735:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140951680:0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.250767:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.250789:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140952192:0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.250816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.250843:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140951808 00000100:00100000:3.0:1790100386.250848:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140951808 00000100:00100000:3.0:1790100386.250875:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140951680 00000100:00100000:3.0:1790100386.250878:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140951680 00000100:00100000:3.0:1790100386.250891:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140952192 00000100:00100000:3.0:1790100386.250894:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140952192 00000100:00100000:3.0:1790100386.250908:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100386.250914:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140951808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.250951:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140951808:12345-0@lo:400:kworker.0 Request processed in 37us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100386.250957:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100386.250969:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790100386.250976:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140951680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.251000:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140951680:12345-0@lo:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100386.251005:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790100386.251015:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790100386.251022:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140952192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.251046:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140952192:12345-0@lo:400:kworker.0 Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100386.251052:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790100386.251068:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140951168 00000100:00100000:3.0:1790100386.251071:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140951168 00000100:00100000:3.0:1790100386.251095:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790100386.251102:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140951168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.251129:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140951168:12345-0@lo:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100386.251140:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790100386.251177:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140951168:0@lo:400:kworker.0 00010000:00080000:3.0:1790100386.251188:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb0000 x1877056140951680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100386.251197:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140951680:0@lo:400:kworker.0 00010000:00080000:3.0:1790100386.251205:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c55f80 x1877056140952192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100386.251213:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140952192:0@lo:400:kworker.0 00010000:00080000:3.0:1790100386.251221:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb1180 x1877056140951808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100386.251230:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140951808:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251308:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140951936 00000100:00100000:0.0:1790100386.251312:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140951936 00000100:00100000:0.0:1790100386.251325:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140951040 00000100:00100000:0.0:1790100386.251327:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140951040 00000100:00100000:0.0:1790100386.251335:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140951552 00000100:00100000:0.0:1790100386.251414:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140951552 00000100:00100000:0.0:1790100386.251496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140952064 00000100:00100000:0.0:1790100386.251499:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140952064 00000100:00100000:0.0:1790100386.251513:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140951296 00000100:00100000:0.0:1790100386.251515:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140951296 00000100:00100000:0.0:1790100386.251525:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790100386.251531:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140951424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251562:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140951424:12345-0@lo:400:kworker.0 Request processed in 32us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.251568:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790100386.251578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790100386.251583:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140951936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251601:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140951936:12345-0@lo:400:kworker.0 Request processed in 19us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.251612:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790100386.251622:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790100386.251627:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140951040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251648:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140951040:12345-0@lo:400:kworker.0 Request processed in 22us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.251653:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790100386.251661:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790100386.251666:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140951552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251684:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140951552:12345-0@lo:400:kworker.0 Request processed in 18us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.251688:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790100386.251696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790100386.251701:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140952064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251718:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140952064:12345-0@lo:400:kworker.0 Request processed in 18us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.251723:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790100386.251731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790100386.251735:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140951296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251759:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140951296:12345-0@lo:400:kworker.0 Request processed in 24us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.251765:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1790100386.251794:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100386.251798:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100386.251800:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100386.251802:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790100386.251824:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb0380 x1877056140950784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100386.251840:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140950784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100386.251860:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140951040:0@lo:400:kworker.0 00010000:00080000:0.0:1790100386.251869:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb2d80 x1877056140951552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100386.251877:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140951552:0@lo:400:kworker.0 00010000:00080000:0.0:1790100386.251885:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083c56a00 x1877056140952064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100386.251893:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140952064:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251900:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140950912:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251907:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140951424:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.251914:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140951936:0@lo:400:kworker.0 00000100:00100000:3.0:1790100386.252071:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140951296:0@lo:400:kworker.0 00000100:00100000:0.0:1790100386.252150:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100386.252157:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140952320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100386.252182:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.252203:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140952320 00000100:00100000:0.0:1790100386.252207:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140952320 00000100:00100000:0.0:1790100386.252227:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790100386.252232:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140952320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100386.252244:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100386.252269:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140952320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.252279:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1790100386.252300:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b79eca80 x1877056140952320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100386.252311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140952320:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1790100386.279907:0:13025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790100386.632586:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100387.656920:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100388.191851:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100388.191938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100388.191965:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100388.191989:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100388.192018:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100388.192046:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127254016 00000100:00100000:2.0:1790100388.192055:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127254016 00000100:00100000:2.0:1790100388.192121:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127254272 00000100:00100000:2.0:1790100388.192126:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127254272 00000100:00100000:2.0:1790100388.192148:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127253888 00000100:00100000:2.0:1790100388.192151:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127253888 00000100:00100000:2.0:1790100388.192170:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127254144 00000100:00100000:2.0:1790100388.192173:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127254144 00000100:00100000:2.0:1790100388.192191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:1.0:1790100388.192233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:1.0:1790100388.192249:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127254272:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100388.192280:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127254016:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100388.192575:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127254272:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 75us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100388.192583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:1.0:1790100388.192604:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:1.0:1790100388.192611:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127253888:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100388.193487:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127253760 00000100:00100000:3.0:1790100388.193496:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127253760 00000100:00100000:3.0:1790100388.193546:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 299 00000100:00100000:3.0:1790100388.193554:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127253760:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100388.196746:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127254016:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4536us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100388.196760:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1790100388.196797:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1790100388.196812:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127254144:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100388.196878:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127254144:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (4859us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100388.196884:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00080000:2.0:1790100388.196915:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100388.196933:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100388.199618:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127253888:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 6996us (7617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100388.199634:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:3.0:1790100388.199636:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127253760:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 6077us (7790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100388.199647:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 299 00000100:00100000:2.0:1790100388.199768:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100388.199832:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100388.200418:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127254400 00000100:00100000:1.0:1790100388.200426:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127254400 00000100:00100000:1.0:1790100388.200553:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127254528 00000100:00100000:1.0:1790100388.200557:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127254528 00000100:00100000:1.0:1790100388.200583:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1790100388.200592:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2418:x1877056127254400:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1790100388.200617:0:8426:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286c60 00000100:00080000:1.0:1790100388.200626:0:8426:0:(import.c:65:import_set_state_nolock()) ffff926083160000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100388.200669:0:8426:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790100388.200806:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+2:2418:x1877056127254400:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 214us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100388.200814:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1790100388.200829:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1790100388.200836:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2418:x1877056127254528:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1790100388.200847:0:8426:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286c67 00000100:00080000:1.0:1790100388.200853:0:8426:0:(import.c:65:import_set_state_nolock()) ffff926083d79800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100388.200886:0:8426:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790100388.200954:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+2:2418:x1877056127254528:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 118us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100388.200961:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00080000:1.0:1790100388.200978:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100388.200981:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790100388.200994:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100388.200998:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100388.680794:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790100388.883038:0:13172:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdda2ae8e0 20000000:00000080:2.0:1790100388.883053:0:13172:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff926082b54400 uarg=0000000000000000 20000000:01000000:2.0:1790100388.883091:0:13172:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790100388.883096:0:13172:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790100388.883100:0:13172:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790100388.884234:0:13173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1790100388.884674:0:13172:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790100388.905081:0:13172:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790100388.905393:0:13172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905422:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905430:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905436:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905442:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905447:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905453:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905471:0:13172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905511:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905529:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 12 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.905545:0:13172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140952448:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100388.905649:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905663:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 23 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.905672:0:13172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140952576:0@lo:104: 00000100:00100000:3.0:1790100388.905707:0:13172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100388.905738:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905748:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 23 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.905757:0:13172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140952704:0@lo:104: 00000100:00100000:3.0:1790100388.905782:0:13172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100388.905809:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.905818:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 23 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.905828:0:13172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140952832:0@lo:104: 00000100:00100000:3.0:1790100388.905851:0:13172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100388.905888:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140952576 00000100:00100000:3.0:1790100388.905894:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140952576 00000100:00100000:3.0:1790100388.905932:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140952704 00000100:00100000:3.0:1790100388.905936:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140952704 00000100:00100000:3.0:1790100388.905949:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140952832 00000100:00100000:3.0:1790100388.905951:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140952832 00000100:00100000:3.0:1790100388.905968:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100388.905979:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+5:13172:x1877056140952576:12345-0@lo:104: 00010000:00010000:3.0:1790100388.906000:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100388.906002:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100388.906017:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+5:13172:x1877056140952704:12345-0@lo:104: 00010000:00010000:2.0:1790100388.906028:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.906062:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100388.906071:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+5:13172:x1877056140952576:12345-0@lo:104: Request processed in 94us (362us total) trans 0 rc 0/0 00010000:00010000:2.0:1790100388.906080:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100388.906081:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790100388.906090:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+5:13172:x1877056140952704:12345-0@lo:104: Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100388.906098:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790100388.906104:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790100388.906112:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+3:13172:x1877056140952832:12345-0@lo:104: 00010000:00010000:3.0:1790100388.906119:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906121:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100388.906130:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906139:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100388.906144:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906154:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.906157:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100388.906167:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+3:13172:x1877056140952832:12345-0@lo:104: Request processed in 56us (315us total) trans 0 rc 0/0 10000000:00010000:2.0:1790100388.906182:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.906184:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 10000000:01000000:2.0:1790100388.906193:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100388.906209:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100388.906216:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.906223:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58c00 already unused, calling callback (ffffffffc13ccc20) 00010000:00010000:2.0:1790100388.906225:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100388.906227:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906242:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100388.906246:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906266:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906274:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083e47a00/0xc87a4f2298286c21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906285:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100388.906288:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906294:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100388.906297:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.906306:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100388.906313:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100388.906314:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100388.906321:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790100388.906327:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790100388.906480:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100388.907491:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.907503:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100388.907515:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.907522:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e58000/0xc87a4f2298286bcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286bd4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.907533:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100388.907535:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100388.907537:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100388.907555:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140952960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100388.907919:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100388.907973:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100388.907982:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140953088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100388.908007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100388.908394:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140952960 00000100:00100000:0.0:1790100388.908401:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140952960 00010000:00010000:0.0:1790100388.908430:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 24 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100388.908470:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140953088 00000100:00100000:0.0:1790100388.908474:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140953088 00010000:00010000:0.0:1790100388.908486:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 25 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100388.908519:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790100388.908527:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+25:3641:x1877056140952960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100388.908538:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100388.908543:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 25 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.908552:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 25 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.908568:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100388.908605:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+25:3641:x1877056140952960:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100388.908627:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790100388.908643:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790100388.908649:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140953088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100388.908657:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100388.908661:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 24 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.908668:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 24 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.908677:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100388.908697:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140953088:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100388.908702:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1790100388.909935:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.909948:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790100388.909999:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140953216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100388.910039:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100388.910498:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140953216 00000100:00100000:1.0:1790100388.910505:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140953216 00010000:00010000:1.0:1790100388.910532:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 24 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100388.910560:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790100388.910567:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140953216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100388.910576:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100388.910580:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 24 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100388.910588:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 24 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100388.910601:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100388.911504:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140953088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100388.911518:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140952960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100388.913176:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.913193:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e58c00/0xc87a4f2298286bf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286bfe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.913210:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100388.913213:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100388.913216:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100388.913235:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.913250:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 24 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100388.913265:0:13172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083edb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140953344:0@lo:104: 00000100:00100000:3.0:1790100388.913298:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100388.913318:0:13172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100388.913364:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127254656 00000100:00100000:3.0:1790100388.913371:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127254656 00010000:00010000:3.0:1790100388.913397:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 13 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.913426:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1790100388.913435:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127254656:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100388.913447:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100388.913453:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 13 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.913478:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 13 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.913504:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100388.913548:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127254656:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 114us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100388.913555:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00010000:00010000:2.0:1790100388.919555:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100388.919579:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.921896:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140953344 00000100:00100000:3.0:1790100388.921909:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140953344 00000100:00100000:3.0:1790100388.921993:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790100388.922003:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+3:13172:x1877056140953344:12345-0@lo:104: 00010000:00010000:3.0:1790100388.922021:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.922108:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100388.922114:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+3:13172:x1877056140953344:12345-0@lo:104: Request processed in 114us (8798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100388.922121:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1790100388.922147:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100388.922152:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.922160:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100388.922164:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.922172:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100388.922179:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100388.922198:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100388.922241:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.922248:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100388.922265:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.922272:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298286ba3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286baa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.922290:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100388.922292:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100388.922293:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100388.922312:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140953600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100388.922364:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100388.922404:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140953600 00000100:00100000:3.0:1790100388.922409:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140953600 00010000:00010000:3.0:1790100388.922425:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 25 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.922445:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790100388.922452:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+25:3644:x1877056140953600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100388.922474:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100388.922479:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 25 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.922489:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 25 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100388.922510:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100388.922536:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+25:3644:x1877056140953600:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100388.922542:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790100388.922573:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140953600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100388.923539:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140953216:12345-0@lo:103:ldlm_bl.0 Request processed in 12968us (13493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100388.923551:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790100388.924186:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140953216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100388.924921:0:13172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140953472:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100388.925062:0:13172:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5600 going to sleep for 11 seconds 00010000:00010000:3.0:1790100388.925083:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565dc00/0xc87a4f2298286c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e087 expref: 12 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.925099:0:13172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140952448:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100388.925112:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286c28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286c21 expref: 23 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.925120:0:13172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140952576:0@lo:104: 00010000:00010000:3.0:1790100388.925131:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286bfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286bf7 expref: 22 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.925140:0:13172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140952704:0@lo:104: 00010000:00010000:3.0:1790100388.925151:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286bd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286bcd expref: 21 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.925158:0:13172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140952832:0@lo:104: 00010000:00010000:3.0:1790100388.925169:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926a00/0xc87a4f2298286baa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286ba3 expref: 20 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.925177:0:13172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083edb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140953344:0@lo:104: 00000100:00100000:1.0:1790100388.928824:0:13172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1877056140953472:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100388.928877:0:13172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100388.930694:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100388.930758:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127254784 00000100:00100000:0.0:1790100388.930769:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127254784 00010000:00010000:0.0:1790100388.930803:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100388.930842:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1790100388.930851:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184257050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:2422:x1877056127254784:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100388.930865:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100388.930871:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930896:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930914:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565d600/0xc87a4f2298286b80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e048 expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930931:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930940:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930956:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930964:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930971:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930978:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930984:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100388.930988:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.930996:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100388.939626:0:13172:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100388.939644:0:13172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.940567:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.940582:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565c600/0xc87a4f2298286c6e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100388.940601:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100388.940710:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184257050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:2422:x1877056127254784:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 9854us (10018us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100388.940720:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1790100389.323015:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100389.323036:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140953728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100389.323107:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100389.323448:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140953728 00000100:00100000:3.0:1790100389.323466:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140953728 00000100:00100000:3.0:1790100389.323522:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100389.323532:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140953728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100389.323558:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100389.323601:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140953728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100389.323608:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1790100389.323666:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790100389.323694:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260831b9c00 x1877056140953728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100389.323711:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140953728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100389.324481:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140953856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100389.324525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100389.325384:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140953856 00000100:00100000:2.0:1790100389.325393:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140953856 00000100:00100000:2.0:1790100389.325464:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790100389.325473:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140953856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100389.325493:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100389.325552:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140953856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100389.325557:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1790100389.325646:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5f100 x1877056140953856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100389.325663:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140953856:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790100389.325724:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790100389.706999:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100389.832834:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100389.832858:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140953984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100389.832923:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100389.835557:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140953984 00000100:00100000:0.0:1790100389.835572:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140953984 00000100:00100000:0.0:1790100389.835640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790100389.835650:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140953984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790100389.835687:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790100389.835767:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140953984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100389.835774:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790100389.835864:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140953984:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1790100390.472398:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100390.472406:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261a6449800 from 7 10000000:01000000:0.0:1790100390.472410:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100390.472475:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.472498:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.472510:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100390.472534:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.472597:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100390.472684:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100390.474474:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140954112 00000100:00100000:1.0:1790100390.474489:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140954112 00000100:00100000:1.0:1790100390.474597:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1790100390.474608:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140954112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100390.474624:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100390.474644:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286c75 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.474668:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.474692:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.474701:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6000, rc 0) 00000100:00100000:1.0:1790100390.474786:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140954112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100390.474792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1790100390.474884:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100390.474913:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.474924:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100390.474996:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.475036:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100390.476182:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100390.476261:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140954240 00000100:00100000:0.0:1790100390.476268:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140954240 00000100:00100000:0.0:1790100390.476314:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790100390.476323:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140954240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.476482:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140954240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100390.476489:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1790100390.476973:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100390.477017:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100390.477058:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100390.477132:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff92619448db40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100390.477188:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140954368 00000100:00100000:0.0:1790100390.477192:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140954368 00000100:00100000:0.0:1790100390.477220:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790100390.477226:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140954368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.477295:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140954368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100390.477302:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1790100390.477375:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100390.478649:0:13228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790100390.478817:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790100390.478838:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100390.478950:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.478972:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100390.478982:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100390.478985:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b6950800 from 7 10000000:01000000:0.0:1790100390.478987:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100390.479014:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.479021:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.479031:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100390.479048:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.479150:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100390.479206:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100390.479241:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140954496 00000100:00100000:1.0:1790100390.479247:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140954496 00000100:00100000:1.0:1790100390.479310:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1790100390.479318:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140954496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100390.479328:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100390.479501:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286c83 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.479523:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.479533:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.479546:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6c00, rc 0) 00000100:00100000:1.0:1790100390.479582:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140954496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100390.479588:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1790100390.479658:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100390.479671:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.479679:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100390.479728:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.479749:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100390.479772:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100390.479815:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140954624 00000100:00100000:2.0:1790100390.479819:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140954624 00000100:00100000:2.0:1790100390.479880:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1790100390.479887:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140954624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.480145:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140954624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100390.480152:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790100390.480220:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100390.480245:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100390.480277:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100390.480295:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c0000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100390.480363:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140954752 00000100:00100000:2.0:1790100390.480367:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140954752 00000100:00100000:2.0:1790100390.480452:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1790100390.480459:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140954752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.480525:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140954752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100390.480531:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1790100390.480619:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100390.481775:0:13229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790100390.487365:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790100390.487476:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790100390.487488:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.487501:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100390.487513:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790100390.487516:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b2026000 from 7 10000000:01000000:2.0:1790100390.487518:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790100390.487556:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.487574:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.487585:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100390.487611:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.487679:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100390.487834:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100390.487889:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140954880 00000100:00100000:0.0:1790100390.487898:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140954880 00000100:00100000:0.0:1790100390.488697:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790100390.488707:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140954880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100390.488722:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100390.488736:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286c91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.488759:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.488770:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.488779:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46400, rc 0) 00000100:00100000:0.0:1790100390.488826:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140954880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100390.488833:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1790100390.488929:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140954880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100390.488943:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.488952:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100390.489010:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.489036:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100390.489763:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100390.489821:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140955008 00000100:00100000:1.0:1790100390.489826:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140955008 00000100:00100000:1.0:1790100390.489967:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1790100390.489977:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140955008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100390.490637:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140955008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 660us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100390.490646:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1790100390.490747:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.490791:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.490834:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100390.490985:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100390.491023:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140955136 00000100:00100000:0.0:1790100390.491028:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140955136 00000100:00100000:0.0:1790100390.491100:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1790100390.491109:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140955136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.491194:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140955136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100390.491201:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1790100390.491265:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790100390.493079:0:13230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790100390.493179:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790100390.493199:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790100390.493209:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.493222:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100390.493232:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790100390.493235:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926187007800 from 7 10000000:01000000:2.0:1790100390.493238:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790100390.493271:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.493279:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.493289:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100390.493310:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.493381:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100390.493753:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100390.493893:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140955264 00000100:00100000:1.0:1790100390.493957:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140955264 00000100:00100000:1.0:1790100390.493995:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1790100390.494003:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140955264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100390.494015:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100390.494027:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286c9f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.494060:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.494070:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.494077:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6800, rc 0) 00000100:00100000:1.0:1790100390.494164:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140955264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100390.494170:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1790100390.494285:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100390.494298:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100390.494307:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100390.494551:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.494580:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100390.495793:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100390.495832:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140955392 00000100:00100000:1.0:1790100390.495838:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140955392 00000100:00100000:1.0:1790100390.496023:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1790100390.496032:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140955392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100390.496158:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140955392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100390.496165:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1790100390.496238:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.496278:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.496324:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100390.496465:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100390.496492:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140955520 00000100:00100000:2.0:1790100390.496496:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140955520 00000100:00100000:2.0:1790100390.496518:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1790100390.496524:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140955520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100390.496592:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140955520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100390.496599:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1790100390.496689:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140955520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100390.497696:0:13231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790100390.497824:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790100390.497959:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100390.497968:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.497980:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100390.728468:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100390.857047:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100390.857068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140955648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100390.857129:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100390.857188:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140955648 00000100:00100000:2.0:1790100390.857195:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140955648 00000100:00100000:2.0:1790100390.857233:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790100390.857240:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140955648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100390.857268:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100390.857304:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140955648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100390.857310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790100390.857360:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140955648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100390.942085:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100390.942181:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127254912 00000100:00100000:1.0:1790100390.942191:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127254912 00000100:00100000:1.0:1790100390.942248:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 312 00000100:00100000:1.0:1790100390.942259:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:6184:x1877056127254912:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100390.942274:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100390.942291:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0b8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.942319:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.942360:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100390.942370:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6600, rc 0) 00000100:00100000:1.0:1790100390.942437:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127254912:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 180us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100390.942455:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 312 00000100:00100000:3.0:1790100390.944110:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100390.949264:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127255040 00000100:00100000:0.0:1790100390.949279:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127255040 00000100:00100000:0.0:1790100390.949415:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 313 00000100:00100000:0.0:1790100390.949426:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127255040:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.949593:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127255040:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 169us (5493us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100390.949601:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 313 00000100:00100000:3.0:1790100390.951186:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100390.956219:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127255168 00000100:00100000:1.0:1790100390.956234:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127255168 00000100:00100000:1.0:1790100390.956289:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 314 00000100:00100000:1.0:1790100390.956299:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127255168:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100390.956452:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127255168:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 145us (5264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100390.956461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 314 00000100:00100000:3.0:1790100390.961240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100390.961375:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127255296 00000100:00100000:0.0:1790100390.961384:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127255296 00000100:00100000:0.0:1790100390.961432:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 315 00000100:00100000:0.0:1790100390.961454:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127255296:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100390.961470:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100390.961488:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0bf expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.961515:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.961535:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100390.961546:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47c00, rc 0) 00000100:00100000:0.0:1790100390.961607:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127255296:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 165us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100390.961614:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 315 00000100:00100000:3.0:1790100390.963466:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100390.963535:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127255424 00000100:00100000:0.0:1790100390.963542:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127255424 00000100:00100000:0.0:1790100390.963587:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 316 00000100:00100000:0.0:1790100390.963595:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127255424:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100390.963717:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127255424:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100390.963724:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 316 00000100:00100000:0.0:1790100390.971378:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100390.971464:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127255552 00000100:00100000:1.0:1790100390.971474:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127255552 00000100:00100000:1.0:1790100390.971526:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 317 00000100:00100000:1.0:1790100390.971537:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127255552:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100390.971663:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127255552:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 128us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100390.971670:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 317 00000100:00100000:0.0:1790100391.368790:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140955776:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.368852:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.368896:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140956288:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.368919:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.368937:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140956800:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.368956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.368978:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790100391.368984:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140955904:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369002:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369030:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140956416:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369065:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140956928:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369084:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369110:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140956032:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369133:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369149:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140956544:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369168:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369184:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140957056:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369201:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369217:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790100391.369222:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140956160:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369250:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140956672:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369278:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369295:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140957184:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369313:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100391.369465:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140956288 00000100:00100000:0.0:1790100391.369473:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140956288 00000100:00100000:0.0:1790100391.369511:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140956800 00000100:00100000:0.0:1790100391.369515:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140956800 00000100:00100000:0.0:1790100391.369527:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140955904 00000100:00100000:0.0:1790100391.369530:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140955904 00000100:00100000:0.0:1790100391.369541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140956416 00000100:00100000:0.0:1790100391.369543:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140956416 00000100:00100000:0.0:1790100391.369552:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140956928 00000100:00100000:0.0:1790100391.369555:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140956928 00000100:00100000:0.0:1790100391.369576:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140956160 00000100:00100000:0.0:1790100391.369579:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140956160 00000100:00100000:0.0:1790100391.369591:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790100391.369597:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140956288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369646:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140956288:12345-0@lo:400:kworker.0 Request processed in 47us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.369652:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790100391.369667:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790100391.369672:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140956800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369696:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140956800:12345-0@lo:400:kworker.0 Request processed in 24us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.369701:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790100391.369710:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790100391.369715:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140955904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369738:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140955904:12345-0@lo:400:kworker.0 Request processed in 23us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.369742:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790100391.369751:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790100391.369757:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140956416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369780:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140956416:12345-0@lo:400:kworker.0 Request processed in 24us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.369785:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790100391.369794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790100391.369799:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140956928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369822:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140956928:12345-0@lo:400:kworker.0 Request processed in 23us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.369834:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790100391.369844:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790100391.369849:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140956160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369879:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140956160:12345-0@lo:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.369883:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790100391.369911:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140956032 00000100:00100000:0.0:1790100391.369915:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140956032 00000100:00100000:0.0:1790100391.369941:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100391.369946:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140956032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.369974:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140956032:12345-0@lo:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.369979:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100391.369995:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140956544 00000100:00100000:0.0:1790100391.369998:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140956544 00000100:00100000:0.0:1790100391.370013:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140957056 00000100:00100000:0.0:1790100391.370015:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140957056 00000100:00100000:0.0:1790100391.370024:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140956672 00000100:00100000:0.0:1790100391.370027:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140956672 00000100:00100000:0.0:1790100391.370036:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140957184 00000100:00100000:0.0:1790100391.370038:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140957184 00000100:00100000:0.0:1790100391.370048:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790100391.370053:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140956544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.370081:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140956544:12345-0@lo:400:kworker.0 Request processed in 28us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.370086:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790100391.370095:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790100391.370106:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140957056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.370131:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140957056:12345-0@lo:400:kworker.0 Request processed in 26us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.370136:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790100391.370146:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790100391.370151:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140956672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.370173:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140956672:12345-0@lo:400:kworker.0 Request processed in 21us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.370178:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790100391.370189:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100391.370194:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140957184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.370215:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140957184:12345-0@lo:400:kworker.0 Request processed in 22us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.370220:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100391.370266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140956160:0@lo:400:kworker.0 00010000:00080000:0.0:1790100391.370278:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6254000 x1877056140956672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100391.370287:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140956672:0@lo:400:kworker.0 00010000:00080000:0.0:1790100391.370296:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6256d80 x1877056140957184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100391.370303:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140957184:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.370311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140956032:0@lo:400:kworker.0 00010000:00080000:0.0:1790100391.370319:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6257480 x1877056140956544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100391.370332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140956544:0@lo:400:kworker.0 00010000:00080000:0.0:1790100391.370362:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6254380 x1877056140957056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100391.370368:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140957056:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.370404:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140955904:0@lo:400:kworker.0 00010000:00080000:0.0:1790100391.370414:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c1b40380 x1877056140956416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100391.370422:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140956416:0@lo:400:kworker.0 00010000:00080000:0.0:1790100391.370430:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6257800 x1877056140956928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100391.370449:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140956928:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.370461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140956288:0@lo:400:kworker.0 00000100:00100000:0.0:1790100391.370469:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140956800:0@lo:400:kworker.0 00000100:00100000:3.0:1790100391.371379:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140955776 00000100:00100000:3.0:1790100391.371385:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140955776 00000100:00100000:3.0:1790100391.371418:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1790100391.371425:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140955776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100391.371480:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140955776:12345-0@lo:400:kworker.0 Request processed in 55us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100391.371487:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1790100391.371515:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100391.371525:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140957312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100391.371551:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100391.371581:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140957312 00000100:00100000:3.0:1790100391.371584:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140957312 00000100:00100000:3.0:1790100391.371618:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790100391.371625:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140957312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790100391.371645:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100391.371985:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140957312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 360us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100391.371993:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1790100391.372165:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260831b8700 x1877056140957312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100391.372182:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140957312:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790100391.373436:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100391.373453:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100391.373456:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100391.373459:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100391.373538:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140957440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100391.373584:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100391.373629:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140957440 00000100:00100000:1.0:1790100391.373636:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140957440 00000100:00100000:1.0:1790100391.373677:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790100391.373686:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140957440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100391.373704:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100391.373758:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140957440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100391.373764:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790100391.373830:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140955776:0@lo:400:kworker.0 00010000:00080000:3.0:1790100391.373978:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd1180 x1877056140957440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100391.373992:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140957440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790100391.753872:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790100392.061159:0:13371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790100392.779172:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100393.309593:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100393.309781:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127255808 00000100:00100000:2.0:1790100393.309791:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127255808 00000100:00100000:0.0:1790100393.309927:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100393.310076:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00080000:3.0:1790100393.310077:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100393.310097:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100393.310101:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127255680 00000100:00100000:3.0:1790100393.310105:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127255680 00000100:00100000:3.0:1790100393.310136:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 319 00000100:00100000:3.0:1790100393.310145:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127255680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100393.310208:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127256064 00000100:00100000:3.0:1790100393.310211:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127255680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100393.310212:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127256064 00000100:00100000:3.0:1790100393.310219:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 319 00000100:00100000:1.0:1790100393.310240:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127255936 00000100:00100000:1.0:1790100393.310243:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127255936 00000100:00100000:1.0:1790100393.310259:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:1.0:1790100393.310264:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2420:x1877056127255808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100393.310324:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:0.0:1790100393.310332:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127256064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100393.310391:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100393.310434:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127256192 00000100:00100000:3.0:1790100393.310444:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127256192 00000100:00100000:3.0:1790100393.310465:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:3.0:1790100393.310471:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127255936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100393.310500:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127255936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100393.310507:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:3.0:1790100393.310521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:3.0:1790100393.310528:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127256192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100393.310551:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127256192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100393.310557:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1790100393.310616:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127256064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 62us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100393.310626:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00080000:2.0:1790100393.310813:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100393.310816:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100393.310889:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2420:x1877056127255808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 624us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100393.310896:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000001:00100000:0.0:1790100393.418727:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000020:00000080:0.0:1790100393.418735:0:8420:0:(genops.c:885:class_export_put()) final put ffff926083160800/fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000020:00000080:3.0:1790100393.418851:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926083160800/fd276aa8-34fd-43b4-a3ff-22c247b7b6ea for lustre-OST0000 00000020:00000080:3.0:1790100393.418897:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083160000 for lustre-OST0000 00000001:00100000:1.0:1790100393.419163:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000020:00000080:1.0:1790100393.419167:0:9503:0:(genops.c:885:class_export_put()) final put ffff926083d7f000/fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000020:00000080:0.0:1790100393.419211:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926083d7f000/fd276aa8-34fd-43b4-a3ff-22c247b7b6ea for lustre-OST0001 00000020:00000080:0.0:1790100393.419241:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083d79800 for lustre-OST0001 00010000:00010000:3.0:1790100393.801009:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100394.440536:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140957568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100394.440607:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100394.440837:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140957568 00000100:00100000:1.0:1790100394.440846:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140957568 00000100:00080000:2.0:1790100394.440882:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100394.440908:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790100394.440920:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140957568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790100394.440948:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100394.440949:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140957696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100394.440984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100394.441004:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140957568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100394.441020:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790100394.441040:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140957696 00010000:00080000:0.0:1790100394.441041:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd1180 x1877056140957568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100394.441046:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140957696 00000100:00100000:0.0:1790100394.441063:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140957568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100394.441085:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790100394.441094:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140957696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100394.441105:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790100394.441141:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100394.441149:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140957696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100394.441156:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1790100394.441270:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5ce00 x1877056140957696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100394.441284:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140957696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100394.825381:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100394.953529:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140957824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100394.953665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100394.953763:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140957824 00000100:00100000:0.0:1790100394.953771:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140957824 00000100:00100000:0.0:1790100394.953820:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100394.953829:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140957824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790100394.953861:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790100394.953908:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140957824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100394.953923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100394.953965:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140957824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790100395.850814:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100395.976536:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140957952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100395.976613:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100395.976713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140957952 00000100:00100000:2.0:1790100395.976721:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140957952 00000100:00100000:2.0:1790100395.976773:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790100395.976783:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140957952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100395.976815:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100395.976869:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140957952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100395.976876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790100395.977061:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140957952:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1790100396.175946:0:13519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:06:34 (1790100394) === 00000100:00100000:0.0:1790100396.304761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100396.304871:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127256320 00000100:00100000:3.0:1790100396.304880:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127256320 00000100:00100000:3.0:1790100396.304941:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1790100396.304952:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:10491:x1877056127256320:12345-192.168.203.13@tcp:700:mkdir.0 00000100:00100000:3.0:1790100396.305021:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:10491:x1877056127256320:12345-192.168.203.13@tcp:700:mkdir.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100396.305027:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00080000:0.0:1790100396.305199:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100396.308639:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100396.308737:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127256576 00000100:00100000:0.0:1790100396.308746:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127256576 00000100:00100000:0.0:1790100396.308836:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1790100396.308848:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:10491:x1877056127256576:12345-192.168.203.13@tcp:36:mkdir.0 00010000:00010000:0.0:1790100396.308899:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100396.308976:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298286aa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e033 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.308994:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6194a00) 00010000:00010000:0.0:1790100396.309007:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100396.309085:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309098:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309109:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309138:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309146:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309167:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309745:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309756:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309763:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100396.309776:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008809a81d reply state 000000006048cad0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309786:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309793:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083e1ba00) 00010000:00010000:0.0:1790100396.309796:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790100396.309799:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790100396.309803:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790100396.309811:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309817:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309824:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309830:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100396.309840:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309848:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309857:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083e1b000) 00010000:00010000:0.0:1790100396.309860:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100396.309864:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309871:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286cbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100396.309887:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008809a81d reply state 000000006048cad0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309896:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.309902:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff926083e1be00) 00010000:00010000:0.0:1790100396.309905:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790100396.309907:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790100396.309998:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:10491:x1877056127256576:12345-192.168.203.13@tcp:36:mkdir.0 Request processed in 1151us (1366us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790100396.310005:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1790100396.319126:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.319235:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127256704 00000100:00100000:1.0:1790100396.319245:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127256704 00000100:00100000:1.0:1790100396.319295:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1790100396.319305:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:10492:x1877056127256704:12345-192.168.203.13@tcp:101:chmod.0 00010000:00010000:1.0:1790100396.319325:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100396.319504:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0c6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.319650:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286cd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.319663:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.319675:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100396.319731:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790100396.319736:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100396.319776:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.319806:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0c6 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.319822:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0c6 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.319831:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926187044100) 00010000:00010000:1.0:1790100396.319834:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100396.319837:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7e00, rc 0) 00000100:00100000:1.0:1790100396.319891:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:10492:x1877056127256704:12345-192.168.203.13@tcp:101:chmod.0 Request processed in 587us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100396.319910:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1790100396.333027:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100396.336466:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127256960 00000100:00100000:3.0:1790100396.336479:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127256960 00000100:00100000:3.0:1790100396.336533:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790100396.336544:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+8:10492:x1877056127256960:12345-192.168.203.13@tcp:36:chmod.0 00010000:00010000:3.0:1790100396.336593:0:9338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100396.336629:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286cd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0c6 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.336648:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926187044100) 00010000:00010000:3.0:1790100396.336659:0:9338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100396.336683:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.336695:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.336705:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100396.336881:0:9338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000495f5a8c reply state 0000000048473f9c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.336893:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.336899:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083b62e00) 00010000:00010000:3.0:1790100396.336902:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790100396.336905:0:9338:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790100396.336919:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790100396.337002:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+9:10492:x1877056127256960:12345-192.168.203.13@tcp:36:chmod.0 Request processed in 460us (3984us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790100396.337009:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1790100396.370969:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100396.371247:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127257088 00000100:00100000:3.0:1790100396.371257:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127257088 00000100:00100000:3.0:1790100396.371313:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1790100396.371324:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:10493:x1877056127257088:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:3.0:1790100396.371371:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100396.371391:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.371463:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286cec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.371477:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.371488:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100396.371527:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790100396.371532:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100396.371570:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.371600:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0cd expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.371616:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286cec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0cd expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.371636:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083b62e00) 00010000:00010000:3.0:1790100396.371638:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100396.371642:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565d400, rc 0) 00000100:00100000:3.0:1790100396.371690:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+10:10493:x1877056127257088:12345-192.168.203.13@tcp:101:chown.0 Request processed in 368us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100396.371697:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1790100396.378765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.378963:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127257216 00000100:00100000:1.0:1790100396.378973:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127257216 00000100:00100000:1.0:1790100396.379028:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1790100396.379038:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+10:10493:x1877056127257216:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:1.0:1790100396.379057:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100396.379075:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0d4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379135:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379166:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379178:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379190:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379197:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379203:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379274:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286d08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379282:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379288:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100396.379333:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790100396.379336:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100396.379375:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286d08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379386:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379411:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379418:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379423:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.379427:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379434:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379446:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083b62e00) 00010000:00010000:1.0:1790100396.379449:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100396.379454:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379492:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379506:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379511:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379517:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379521:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.379531:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379537:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379545:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff926083e1be00) 00010000:00010000:1.0:1790100396.379547:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100396.379549:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379554:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379578:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0d4 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379589:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286d08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0d4 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.379595:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083e1ba00) 00010000:00010000:1.0:1790100396.379597:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100396.379599:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7200, rc 0) 00000100:00100000:1.0:1790100396.379693:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:10493:x1877056127257216:12345-192.168.203.13@tcp:101:chown.0 Request processed in 656us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100396.379699:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1790100396.386713:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100396.386889:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127257344 00000100:00100000:2.0:1790100396.386898:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127257344 00000100:00100000:2.0:1790100396.386954:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1790100396.386964:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:10493:x1877056127257344:12345-192.168.203.13@tcp:900:chown.0 00000100:00100000:2.0:1790100396.387045:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:10493:x1877056127257344:12345-192.168.203.13@tcp:900:chown.0 Request processed in 82us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100396.387052:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1790100396.392700:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100396.392784:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127257600 00000100:00100000:3.0:1790100396.392794:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127257600 00000100:00100000:3.0:1790100396.392850:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1790100396.392860:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+11:10493:x1877056127257600:12345-192.168.203.13@tcp:36:chown.0 00010000:00010000:3.0:1790100396.392910:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100396.392935:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286d08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0d4 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.392954:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083e1ba00) 00010000:00010000:3.0:1790100396.392959:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100396.392981:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.392993:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.393003:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100396.395842:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1790100396.395904:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c22a75ee reply state 00000000384f086d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.395924:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.395933:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083e1ba00) 00010000:00010000:0.0:1790100396.395936:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790100396.395940:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790100396.395952:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790100396.396188:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396200:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396215:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396222:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.396227:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396235:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1790100396.396240:0:12139:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1790100396.396249:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff926083e1be00) 00010000:00010000:1.0:1790100396.396253:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100396.396257:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100396.396259:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+9:10493:x1877056127257600:12345-192.168.203.13@tcp:36:chown.0 Request processed in 3396us (3565us total) trans 4294967301 rc 0/0 00010000:00010000:1.0:1790100396.396271:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286cc2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396293:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396299:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396305:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396310:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.396313:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396329:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396364:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083e1ba00) 00010000:00010000:1.0:1790100396.396368:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100396.396372:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396378:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286cc9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396392:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396398:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396422:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396427:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565dc00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.396430:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396436:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396444:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083b62e00) 00010000:00010000:1.0:1790100396.396447:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100396.396450:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396468:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286cde lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396539:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396546:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396553:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396558:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.396561:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396567:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396576:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083e1ba00) 00010000:00010000:1.0:1790100396.396579:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100396.396582:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.396588:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d0f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100396.396854:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1790100396.407309:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100396.407429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127257728 00000100:00100000:3.0:1790100396.407452:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127257728 00000100:00100000:3.0:1790100396.407509:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1790100396.407519:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:10494:x1877056127257728:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:3.0:1790100396.407549:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100396.407568:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286d16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100396.414679:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7063us 00010000:00010000:3.0:1790100396.431711:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.431735:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.431747:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.431765:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.431773:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.431780:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.431916:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e59000/0xc87a4f2298286d2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.431923:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e59000/0xc87a4f2298286d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.431942:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e59000/0xc87a4f2298286d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100396.431973:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790100396.431977:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100396.432014:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e59000/0xc87a4f2298286d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432026:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432031:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432037:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432043:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100396.432046:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432053:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432063:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083b62e00) 00010000:00010000:3.0:1790100396.432066:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100396.432071:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432077:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432099:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432105:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432109:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432114:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565dc00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100396.432116:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432120:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432127:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff926083b62f00) 00010000:00010000:3.0:1790100396.432129:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100396.432132:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432137:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286d24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432172:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286d16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0db expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432186:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e59000/0xc87a4f2298286d2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0db expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.432203:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62900) 00010000:00010000:3.0:1790100396.432206:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790100396.432208:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e59000, rc 0) 00000100:00100000:3.0:1790100396.432267:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:10494:x1877056127257728:12345-192.168.203.13@tcp:101:touch.500 Request processed in 24749us (24965us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100396.432275:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1790100396.438412:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.443097:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127257984 00000100:00100000:1.0:1790100396.443110:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127257984 00000100:00100000:1.0:1790100396.443167:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1790100396.443174:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:10494:x1877056127257984:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:1.0:1790100396.443202:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100396.443219:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286d32 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0e2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.443300:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.443311:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.443320:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.443332:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.443358:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.443366:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790100396.443888:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1790100396.444117:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286d47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444128:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286d47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444136:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286d47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444179:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444186:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444193:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444200:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.444203:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444211:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444222:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62900) 00010000:00010000:1.0:1790100396.444225:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100396.444229:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444236:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100396.444247:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009abe6e2d reply state 000000003e75bb99 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444257:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444264:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff926187044500) 00010000:00010000:1.0:1790100396.444275:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100396.444278:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790100396.444311:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286d32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0e2 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444325:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286d47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0e2 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.444333:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff926187044e00) 00010000:00010000:1.0:1790100396.444334:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100396.444337:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7000, rc 0) 00000100:00100000:1.0:1790100396.444486:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+10:10494:x1877056127257984:12345-192.168.203.13@tcp:101:touch.500 Request processed in 1310us (6094us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790100396.444494:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1790100396.452781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.453117:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127258240 00000100:00100000:1.0:1790100396.453130:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127258240 00000100:00100000:0.0:1790100396.453244:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1790100396.453254:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+10:10494:x1877056127258240:12345-192.168.203.13@tcp:36:touch.500 00010000:00010000:0.0:1790100396.453304:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100396.453327:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286d47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0e2 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.453504:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff926187044e00) 00010000:00010000:0.0:1790100396.453515:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100396.453566:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.453650:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.453675:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100396.453768:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000482c8107 reply state 00000000957b0cda transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.453780:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.453786:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9261c1af1400) 00010000:00010000:0.0:1790100396.453789:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790100396.453791:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100396.453908:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+11:10494:x1877056127258240:12345-192.168.203.13@tcp:36:touch.500 Request processed in 647us (1127us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790100396.453916:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1790100396.456953:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.457679:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127258368 00000100:00100000:1.0:1790100396.457688:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127258368 00000100:00100000:1.0:1790100396.457813:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1790100396.457823:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+11:10494:x1877056127258368:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:1.0:1790100396.457874:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100396.457893:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286d5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.458102:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286d5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0e9 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.458118:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286d5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0e9 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.458152:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9261c1af1400) 00010000:00010000:1.0:1790100396.458155:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100396.458159:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6200, rc 0) 00000100:00100000:1.0:1790100396.458218:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+12:10494:x1877056127258368:12345-192.168.203.13@tcp:101:touch.500 Request processed in 396us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100396.458225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1790100396.462800:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100396.462851:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127258496 00000100:00100000:3.0:1790100396.462860:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127258496 00000100:00100000:3.0:1790100396.462901:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790100396.462909:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2418:x1877056127258496:12345-192.168.203.13@tcp:8:touch.500 00010000:00080000:3.0:1790100396.462954:0:8426:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:3.0:1790100396.463109:0:8426:0:(genops.c:1384:class_connect()) connect: client e84eb833-b466-4273-a7db-c12bb35adfb4, cookie 0xc87a4f2298286d63 00002000:00100000:3.0:1790100396.463122:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e84eb833-b466-4273-a7db-c12bb35adfb4/ffff926083dab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790100396.463139:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790100396.463325:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790100396.463375:0:8426:0:(import.c:65:import_set_state_nolock()) ffff926083daf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100396.463453:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2418:x1877056127258496:12345-192.168.203.13@tcp:8:touch.500 Request processed in 542us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100396.463460:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790100396.466057:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100396.466181:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127258624 00000100:00100000:0.0:1790100396.466190:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127258624 00000100:00100000:0.0:1790100396.466255:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1790100396.466265:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:0:x1877056127258624:12345-192.168.203.13@tcp:2:touch.500 00000100:00080000:2.0:1790100396.466290:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790100396.476042:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1790100396.476054:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000100:00100000:0.0:1790100396.483855:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:0:x1877056127258624:12345-192.168.203.13@tcp:2:touch.500 Request processed in 17581us (17796us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790100396.483869:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1790100396.488683:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140958464:0@lo:400:kworker.0 00000100:00100000:3.0:1790100396.488767:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.488818:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140958080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100396.488825:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140958976:0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.489517:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100396.489523:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100396.489559:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140959488:0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.489588:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140958592:0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.489615:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.489641:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140959104:0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.489662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.489676:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140959616:0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.489692:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.489709:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790100396.489714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140958208:0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.489731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.489745:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140958720:0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.489761:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.489774:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140959232:0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.489791:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.489819:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140958336:0@lo:400:kworker.0 00000100:00100000:3.0:1790100396.489826:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.489848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100396.489868:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140958976 00000100:00100000:0.0:1790100396.489872:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140958848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100396.489877:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140958976 00000100:00100000:0.0:1790100396.489896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100396.489914:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140959360:0@lo:400:kworker.0 00000100:00100000:3.0:1790100396.489928:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140959104 00000100:00100000:3.0:1790100396.489933:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140959104 00000100:00100000:0.0:1790100396.489935:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100396.489956:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140959616 00000100:00100000:3.0:1790100396.489960:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140959616 00000100:00100000:0.0:1790100396.489965:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140958848 00000100:00100000:0.0:1790100396.489970:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140958848 00000100:00100000:3.0:1790100396.489975:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140959488 00000100:00100000:3.0:1790100396.489980:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140959488 00000100:00100000:0.0:1790100396.490005:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100396.490014:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1877056140958848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100396.490040:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100396.490081:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1877056140958848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.490090:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790100396.490109:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790100396.490118:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140958976:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1790100396.490140:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260831bb800 x1877056140958848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100396.490160:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140958848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100396.490164:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140958976:12345-0@lo:400:kworker.0 Request processed in 44us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100396.490172:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790100396.490189:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140958464 00000100:00100000:3.0:1790100396.490193:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790100396.490194:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140958464 00000100:00100000:3.0:1790100396.490202:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140959104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.490217:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140958592 00000100:00100000:0.0:1790100396.490221:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140958592 00000100:00100000:0.0:1790100396.490238:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140958208 00000100:00100000:0.0:1790100396.490240:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140958208 00000100:00100000:3.0:1790100396.490246:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140959104:12345-0@lo:400:kworker.0 Request processed in 45us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.490252:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140958720 00000100:00100000:3.0:1790100396.490255:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790100396.490256:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140958720 00000100:00100000:0.0:1790100396.490276:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140959232 00000100:00100000:3.0:1790100396.490277:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790100396.490280:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140959232 00000100:00100000:3.0:1790100396.490288:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140959616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.490297:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140959360 00000100:00100000:0.0:1790100396.490300:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140959360 00000100:00100000:0.0:1790100396.490320:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790100396.490328:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140959616:12345-0@lo:400:kworker.0 Request processed in 42us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.490330:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140958464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100396.490373:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790100396.490394:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790100396.490394:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140958464:12345-0@lo:400:kworker.0 Request processed in 64us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100396.490416:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140959488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.490418:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790100396.490447:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790100396.490455:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140958592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100396.490457:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140959488:12345-0@lo:400:kworker.0 Request processed in 53us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100396.490466:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1790100396.490492:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790100396.490496:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140958080 00000100:00080000:3.0:1790100396.490498:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100396.490499:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140958592:12345-0@lo:400:kworker.0 Request processed in 44us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100396.490503:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140958080 00000100:00080000:3.0:1790100396.490504:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100396.490509:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100396.490509:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790100396.490528:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790100396.490536:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140958208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100396.490546:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1790100396.490557:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140958080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.490571:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140958208:12345-0@lo:400:kworker.0 Request processed in 35us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.490584:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790100396.490602:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790100396.490607:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140958080:12345-0@lo:400:kworker.0 Request processed in 50us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.490612:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140958720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100396.490626:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1790100396.490650:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140958720:12345-0@lo:400:kworker.0 Request processed in 40us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.490657:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790100396.490672:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790100396.490681:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140959232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100396.490711:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140959232:12345-0@lo:400:kworker.0 Request processed in 33us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.490749:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790100396.490756:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790100396.490761:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140959360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100396.490797:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140959360:12345-0@lo:400:kworker.0 Request processed in 40us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.490803:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00080000:2.0:1790100396.490823:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5d500 x1877056140959360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100396.490833:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140959360:0@lo:400:kworker.0 00000100:00100000:1.0:1790100396.491594:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140958336 00000100:00100000:1.0:1790100396.491599:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140958336 00000100:00100000:0.0:1790100396.491602:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140959744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100396.491638:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790100396.491644:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100396.491652:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140958336:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1790100396.491658:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5ca80 x1877056140959488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100396.491670:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140959488:0@lo:400:kworker.0 00000100:00100000:2.0:1790100396.491688:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140958464:0@lo:400:kworker.0 00010000:00080000:2.0:1790100396.491706:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5c000 x1877056140958976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100396.491710:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140958336:12345-0@lo:400:kworker.0 Request processed in 59us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.491722:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140958336:0@lo:400:kworker.0 00000100:00100000:1.0:1790100396.491727:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790100396.491728:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140958976:0@lo:400:kworker.0 00000100:00100000:1.0:1790100396.491759:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140959744 00000100:00100000:1.0:1790100396.491764:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140959744 00000100:00100000:1.0:1790100396.491792:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790100396.491799:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140959744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100396.491814:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100396.491850:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140959744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100396.491856:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1790100396.491881:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083edb800 x1877056140959744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100396.491896:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140959744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100396.492195:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.492247:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127258880 00000100:00100000:3.0:1790100396.492252:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140958208:0@lo:400:kworker.0 00000100:00100000:1.0:1790100396.492254:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127258880 00010000:00080000:3.0:1790100396.492270:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5d880 x1877056140958720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100396.492281:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140958720:0@lo:400:kworker.0 00000100:00100000:1.0:1790100396.492295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1790100396.492298:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140959232:0@lo:400:kworker.0 00000100:00100000:3.0:1790100396.492311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140958080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100396.492458:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140958592:0@lo:400:kworker.0 00010000:00080000:3.0:1790100396.492469:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5d180 x1877056140959104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100396.492477:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140959104:0@lo:400:kworker.0 00010000:00080000:3.0:1790100396.492486:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5ce00 x1877056140959616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100396.492511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140959616:0@lo:400:kworker.0 00000100:00100000:1.0:1790100396.492541:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+12:10494:x1877056127258880:12345-192.168.203.13@tcp:35:touch.500 00000100:00100000:1.0:1790100396.492778:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+13:10494:x1877056127258880:12345-192.168.203.13@tcp:35:touch.500 Request processed in 474us (2207us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790100396.492786:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1790100396.505520:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100396.505769:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127259008 00000100:00100000:2.0:1790100396.505779:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127259008 00000100:00100000:2.0:1790100396.505826:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1790100396.505836:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+13:10495:x1877056127259008:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:2.0:1790100396.505858:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100396.505877:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298286d6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.506233:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286d71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.506247:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.506258:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100396.506302:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790100396.506306:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100396.506566:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.506594:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298286d6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0f0 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.506613:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0f0 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.506620:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62900) 00010000:00010000:2.0:1790100396.506623:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100396.506627:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927200, rc 0) 00000100:00100000:2.0:1790100396.506689:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+14:10495:x1877056127259008:12345-192.168.203.13@tcp:101:rm.0 Request processed in 854us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100396.506697:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1790100396.510809:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.510919:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127259264 00000100:00100000:1.0:1790100396.510930:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127259264 00000100:00100000:1.0:1790100396.510998:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1790100396.511009:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+14:10495:x1877056127259264:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1790100396.511029:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100396.511048:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0f7 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100396.511138:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790100396.511240:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0f7 expref: 16 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.511254:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083b62e00) 00010000:00010000:1.0:1790100396.511256:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100396.511261:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0f7 expref: 16 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.511274:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7800, rc 0) 00000100:00100000:1.0:1790100396.511332:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+15:10495:x1877056127259264:12345-192.168.203.13@tcp:101:rm.0 Request processed in 326us (533us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1790100396.514205:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100396.514501:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127259392 00000100:00100000:0.0:1790100396.514511:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127259392 00000100:00100000:0.0:1790100396.514565:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1790100396.514574:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+16:10495:x1877056127259392:12345-192.168.203.13@tcp:37:rm.0 00000100:00100000:1.0:1790100396.516680:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1790100396.518769:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+15:10495:x1877056127259392:12345-192.168.203.13@tcp:37:rm.0 Request processed in 4188us (4565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100396.518793:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1790100396.522132:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.522203:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127259648 00000100:00100000:1.0:1790100396.522213:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127259648 00000100:00100000:1.0:1790100396.522267:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1790100396.522276:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+15:10495:x1877056127259648:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:1.0:1790100396.522539:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+16:10495:x1877056127259648:12345-192.168.203.13@tcp:35:rm.0 Request processed in 263us (414us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790100396.522547:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1790100396.525975:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.526065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127259904 00000100:00100000:1.0:1790100396.526074:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127259904 00000100:00100000:1.0:1790100396.526130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1790100396.526141:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+16:10495:x1877056127259904:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1790100396.526162:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100396.526181:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e0fe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.526281:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7a00/0xc87a4f2298286d8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.526296:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7a00/0xc87a4f2298286d8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.526308:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7a00/0xc87a4f2298286d8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100396.526318:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790100396.526460:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0fe expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.526491:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7a00/0xc87a4f2298286d8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0fe expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.526500:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62900) 00010000:00010000:1.0:1790100396.526504:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100396.526507:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7a00, rc 0) 00000100:00100000:1.0:1790100396.526567:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+18:10495:x1877056127259904:12345-192.168.203.13@tcp:101:rm.0 Request processed in 427us (602us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790100396.526573:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1790100396.529151:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100396.529237:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127260032 00000100:00100000:0.0:1790100396.529245:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127260032 00000100:00100000:0.0:1790100396.529295:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1790100396.529304:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:10495:x1877056127260032:12345-192.168.203.13@tcp:41:rm.0 00000004:00000024:0.0:1790100396.529384:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1790100396.529456:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:10495:x1877056127260032:12345-192.168.203.13@tcp:41:rm.0 Request processed in 152us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.529463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1790100396.531696:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.531763:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127260160 00000100:00100000:1.0:1790100396.531771:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127260160 00000100:00100000:1.0:1790100396.531820:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1790100396.531828:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+18:10495:x1877056127260160:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1790100396.531846:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100396.531862:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e105 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.531926:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.531940:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.531957:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.531967:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.531987:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.531994:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532070:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286db0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532078:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532085:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100396.532119:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790100396.532124:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100396.532141:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532151:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532159:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532165:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532172:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532188:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.532193:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532200:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532213:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62900) 00010000:00010000:1.0:1790100396.532216:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100396.532221:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532227:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286da2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532238:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532244:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532250:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532255:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100396.532257:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532262:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532280:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff926187044500) 00010000:00010000:1.0:1790100396.532282:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100396.532285:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532291:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286da9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532314:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286d9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e105 expref: 20 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532327:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e105 expref: 19 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.532334:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9261c1af1400) 00010000:00010000:1.0:1790100396.532522:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100396.532526:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7000, rc 0) 00000100:00100000:1.0:1790100396.532610:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+19:10495:x1877056127260160:12345-192.168.203.13@tcp:101:rm.0 Request processed in 782us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100396.532618:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1790100396.535643:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100396.535714:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127260416 00000100:00100000:0.0:1790100396.535724:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127260416 00000100:00100000:0.0:1790100396.535779:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1790100396.535787:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+19:10495:x1877056127260416:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:0.0:1790100396.535834:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790100396.535857:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298286db0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e105 expref: 19 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.535877:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6200/0xc87a4f2298286d5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0e9 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.535888:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9261c1af1400) 00010000:00010000:0.0:1790100396.535897:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0f0 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.535918:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62900) 00010000:00010000:0.0:1790100396.535921:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100396.535940:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.535971:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.535982:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.535993:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536000:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536007:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536115:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536124:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536131:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100396.536329:0:12139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790100396.536649:0:12139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 247824308105ns, next at 248823996392ns, rc = 0 00010000:00010000:0.0:1790100396.536698:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536708:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536727:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536735:0:12139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536741:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536747:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536769:0:12139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100396.536787:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536792:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536799:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536804:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100396.536808:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536816:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536824:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9261c1af1400) 00010000:00010000:0.0:1790100396.536827:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790100396.536838:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536845:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286dc5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536862:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536869:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536874:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536879:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100396.536882:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536888:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536896:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62900) 00010000:00010000:0.0:1790100396.536898:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100396.536901:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536906:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286db7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100396.536916:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e7af1a4 reply state 00000000542253b6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.536938:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.537025:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100396.537032:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.537038:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100396.537041:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.537048:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.537057:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9261c1af1400) 00010000:00010000:3.0:1790100396.537060:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790100396.537062:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.537068:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298286dcc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.537077:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100396.537079:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100396.537081:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100396.537109:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff926187044500) 00010000:00010000:0.0:1790100396.537112:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790100396.537116:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100396.537188:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+18:10495:x1877056127260416:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1399us (1551us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790100396.537196:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1790100396.542992:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.543097:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127260672 00000100:00100000:1.0:1790100396.543110:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127260672 00000100:00100000:1.0:1790100396.543159:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1790100396.543168:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:10495:x1877056127260672:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:1.0:1790100396.543428:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+19:10495:x1877056127260672:12345-192.168.203.13@tcp:35:rm.0 Request processed in 257us (443us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790100396.543444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1790100396.544946:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100396.545027:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127260928 00000100:00100000:1.0:1790100396.545034:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127260928 00000100:00100000:2.0:1790100396.545101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1790100396.545111:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+19:10495:x1877056127260928:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1790100396.545155:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790100396.545179:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7a00/0xc87a4f2298286d8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0fe expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.545198:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e59000/0xc87a4f2298286d2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0db expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.545210:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62900) 00010000:00010000:2.0:1790100396.545223:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286cec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0cd expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.545229:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083b62e00) 00010000:00010000:2.0:1790100396.545233:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100396.545253:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.545265:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.545274:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.545286:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.545293:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.545312:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545492:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545505:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545511:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100396.545691:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790100396.545703:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545708:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545712:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545716:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100396.545719:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545723:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545729:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff926083b62f00) 00010000:00010000:3.0:1790100396.545730:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790100396.545733:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545737:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58000/0xc87a4f2298286de1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545747:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545755:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545759:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545762:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100396.545763:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545767:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545771:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b400) 00010000:00010000:3.0:1790100396.545772:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100396.545774:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545777:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286dd3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100396.545785:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c125d604 reply state 000000000b12b83b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545791:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100396.545795:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9261b209b300) 00010000:00010000:3.0:1790100396.545796:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790100396.545798:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100396.545848:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+18:10495:x1877056127260928:12345-192.168.203.13@tcp:36:rm.0 Request processed in 738us (947us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790100396.545860:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00010000:00010000:3.0:1790100396.873261:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100397.897726:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100398.431082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100398.431122:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100398.431154:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100398.431185:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100398.431207:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100398.431250:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100398.431276:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127261440 00000100:00100000:2.0:1790100398.431284:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127261440 00000100:00100000:2.0:1790100398.431442:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1790100398.431453:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127261440:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100398.431517:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127261440:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100398.431525:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00080000:2.0:1790100398.431546:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100398.431673:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127261312 00000100:00100000:0.0:1790100398.431678:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127261312 00000100:00100000:3.0:1790100398.431719:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127261056 00000100:00100000:3.0:1790100398.431725:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127261056 00000100:00100000:0.0:1790100398.431725:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127261568 00000100:00100000:0.0:1790100398.431731:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127261568 00000100:00100000:0.0:1790100398.431753:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127261184 00000100:00100000:0.0:1790100398.431756:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127261184 00000100:00100000:3.0:1790100398.431760:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 321 00000100:00100000:3.0:1790100398.431771:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127261056:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100398.431774:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127261696 00000100:00100000:0.0:1790100398.431778:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127261696 00000100:00100000:0.0:1790100398.431799:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:3.0:1790100398.431806:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127261056:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100398.431809:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127261312:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100398.431820:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 321 00000100:00100000:0.0:1790100398.431866:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127261312:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 60us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100398.431873:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:0.0:1790100398.431893:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:0.0:1790100398.431900:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127261568:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100398.431923:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127261568:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100398.431928:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:0.0:1790100398.431949:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:0.0:1790100398.431955:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2422:x1877056127261184:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100398.431979:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2422:x1877056127261184:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100398.431985:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:0.0:1790100398.431996:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:0.0:1790100398.432001:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127261696:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100398.432035:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127261696:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100398.432040:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00080000:2.0:1790100398.433278:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100398.433284:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1790100398.920681:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790100399.104997:0:13667:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1790100399.561530:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100399.561550:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140959872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100399.561604:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100399.561675:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140959872 00000100:00100000:0.0:1790100399.561682:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140959872 00000100:00100000:0.0:1790100399.561729:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790100399.561738:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140959872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100399.561771:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100399.561806:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140959872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100399.561813:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1790100399.561831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790100399.561856:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6254380 x1877056140959872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100399.561873:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140959872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100399.562806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140960000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100399.562840:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790100399.562908:0:8966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 250850567640ns, next at 251850565347ns, rc = 0 00000100:00100000:3.0:1790100399.563737:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140960000 00000100:00100000:3.0:1790100399.563745:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140960000 00000100:00100000:3.0:1790100399.563792:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790100399.563801:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140960000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100399.563819:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790100399.563912:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100399.564540:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140960000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 738us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100399.564548:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1790100399.564724:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5f800 x1877056140960000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100399.564741:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140960000:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100399.945911:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790100400.019713:0:13715:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd84e3b410 20000000:00000080:1.0:1790100400.019734:0:13715:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff926083f02c00 uarg=0000000000000000 20000000:01000000:1.0:1790100400.019772:0:13715:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790100400.019778:0:13715:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790100400.019782:0:13715:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790100400.020907:0:13716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1790100400.021549:0:13715:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1790100400.033727:0:13715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1790100400.033761:0:13715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1790100400.033778:0:13715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1790100400.033793:0:13715:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790100400.033810:0:13715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033826:0:13715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033843:0:13715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033849:0:13715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033855:0:13715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033862:0:13715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033869:0:13715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033875:0:13715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033909:0:13715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.033922:0:13715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 12 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.033934:0:13715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960128:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100400.034034:0:13715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.034043:0:13715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 12 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.034470:0:13715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960256:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100400.034664:0:13715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.034674:0:13715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 23 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.034684:0:13715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960384:0@lo:104: 00000100:00100000:3.0:1790100400.034720:0:13715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100400.034751:0:13715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.034760:0:13715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 23 pid: 6507 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.034769:0:13715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960512:0@lo:104: 00010000:00010000:3.0:1790100400.034793:0:13715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.034801:0:13715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 23 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.034808:0:13715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960640:0@lo:104: 00000100:00100000:0.0:1790100400.034808:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790100400.034824:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100400.034847:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140960384 00000100:00100000:0.0:1790100400.034852:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140960512 00000100:00100000:3.0:1790100400.034854:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140960384 00000100:00100000:0.0:1790100400.034855:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140960512 00000100:00100000:1.0:1790100400.034903:0:13715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790100400.034939:0:13715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100400.034947:0:13715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 23 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100400.034955:0:13715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960768:0@lo:104: 00000100:00100000:1.0:1790100400.034978:0:13715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100400.034991:0:13715:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261933bc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100400.035016:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140960640 00000100:00100000:2.0:1790100400.035020:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140960640 00000100:00100000:0.0:1790100400.035030:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140960768 00000100:00100000:0.0:1790100400.035032:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140960768 00000100:00100000:3.0:1790100400.040458:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100400.040476:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+6:13715:x1877056140960512:12345-0@lo:104: 00010000:00010000:3.0:1790100400.040511:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040598:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100400.040605:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+6:13715:x1877056140960512:12345-0@lo:104: Request processed in 136us (5780us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100400.040612:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100400.040632:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790100400.040639:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+5:13715:x1877056140960384:12345-0@lo:104: 00010000:00010000:3.0:1790100400.040652:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040685:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100400.040691:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a237a43-d248-40fc-b145-fd7f23146511+5:13715:x1877056140960384:12345-0@lo:104: Request processed in 53us (5971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100400.040696:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1790100400.040745:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100400.040751:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040759:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926e00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100400.040763:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040772:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100400.040779:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100400.040792:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100400.040827:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040834:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100400.040854:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040862:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083926e00/0xc87a4f2298286c91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040879:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100400.040882:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040888:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100400.040891:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040898:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100400.040904:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100400.040910:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100400.040922:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040928:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100400.040949:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040956:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083926200/0xc87a4f2298286c9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286ca6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.040965:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100400.040967:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100400.040969:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100400.040983:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140960896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100400.041035:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100400.041075:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100400.041082:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140961024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100400.041106:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100400.041144:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140960896 00000100:00100000:1.0:1790100400.041150:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100400.041152:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140960896 00010000:00010000:3.0:1790100400.041181:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 24 pid: 6507 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.041203:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140961024 00000100:00100000:3.0:1790100400.041207:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140961024 00010000:00010000:3.0:1790100400.041220:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 25 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.041231:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127261824 00000100:00100000:3.0:1790100400.041234:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127261824 00000100:00100000:1.0:1790100400.041242:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:3.0:1790100400.041249:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 13 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.041264:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127261952 00000100:00100000:3.0:1790100400.041267:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127261952 00010000:00010000:3.0:1790100400.041288:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 14 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.041304:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790100400.041311:0:13715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960128:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100400.041314:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+25:3643:x1877056140960896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100400.041327:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790100400.041327:0:13715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960256:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100400.041356:0:13715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960384:0@lo:104: 00000100:00100000:1.0:1790100400.041368:0:13715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960512:0@lo:104: 00010000:00010000:3.0:1790100400.041369:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 25 pid: 6507 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041391:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 25 pid: 6507 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041405:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083e46400/0xc87a4f2298286c98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286c91 expref: 25 pid: 6507 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100400.041444:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790100400.041453:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140961024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100400.041467:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100400.041473:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 24 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100400.041482:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 24 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041496:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100400.041529:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140960896:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100400.041536:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790100400.041550:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1790100400.041557:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+14:2422:x1877056127261824:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100400.041565:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100400.041570:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 14 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041580:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 14 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041591:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083e47c00/0xc87a4f2298286cb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0bf expref: 14 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041606:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100400.041667:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286ca6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286c9f expref: 23 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100400.041679:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100400.041685:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127261824:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 127us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100400.041693:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1790100400.041712:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+22:3643:x1877056140961024:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100400.041713:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1790100400.041725:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790100400.041727:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:2421:x1877056127261952:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100400.041736:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100400.041742:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 12 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041753:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 12 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041764:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6600/0xc87a4f2298286cad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e0b8 expref: 12 pid: 6505 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.041772:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100400.041789:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:2421:x1877056127261952:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 66us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100400.041795:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1790100400.041828:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140961024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100400.041836:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140960896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100400.041868:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100400.044464:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790100400.044484:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:13715:x1877056140960640:12345-0@lo:104: 00010000:00010000:2.0:1790100400.044513:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.044596:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100400.044602:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a237a43-d248-40fc-b145-fd7f23146511+4:13715:x1877056140960640:12345-0@lo:104: Request processed in 129us (9699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100400.044610:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1790100400.044636:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100400.044642:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.044650:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47600 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100400.044654:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.044662:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100400.044670:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100400.044675:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790100400.044703:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.044709:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100400.044729:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.044735:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083e47600/0xc87a4f2298286c83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.044753:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100400.044754:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100400.044756:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100400.044769:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140961152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100400.044801:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100400.044848:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140961152 00000100:00100000:2.0:1790100400.044854:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140961152 00010000:00010000:2.0:1790100400.044875:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 22 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100400.044898:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790100400.044905:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+22:3641:x1877056140961152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100400.044914:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100400.044918:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 22 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.044928:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 22 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.044943:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100400.044969:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+22:3641:x1877056140961152:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100400.044974:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790100400.045004:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140961152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100400.045307:0:13715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6c00/0xc87a4f2298286c8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286c83 expref: 21 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100400.045460:0:13715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960640:0@lo:104: 00000100:00100000:0.0:1790100400.046073:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790100400.046085:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+3:13715:x1877056140960768:12345-0@lo:104: 00010000:00010000:0.0:1790100400.046096:0:8441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100400.046159:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100400.046165:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2a237a43-d248-40fc-b145-fd7f23146511+3:13715:x1877056140960768:12345-0@lo:104: Request processed in 85us (11187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100400.046171:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1790100400.046321:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100400.046327:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.046418:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46800 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100400.046421:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.046562:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100400.046571:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100400.046576:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790100400.046691:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.046707:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100400.046724:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.046730:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083e46800/0xc87a4f2298286c75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298286c7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.046742:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100400.046744:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100400.046746:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100400.046756:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140961280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100400.046788:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100400.047039:0:13715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13715:1877056140960768:0@lo:104: 00010000:00010000:1.0:1790100400.047081:0:13715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.047259:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140961280 00000100:00100000:3.0:1790100400.047265:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140961280 00010000:00010000:3.0:1790100400.047286:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 21 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.047314:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790100400.047321:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a237a43-d248-40fc-b145-fd7f23146511+21:3642:x1877056140961280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100400.047330:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100400.047335:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 21 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047537:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 21 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047551:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286c7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298286c75 expref: 21 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047564:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047578:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047592:0:9513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047598:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047604:0:9513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047610:0:9513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047615:0:9513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58c00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100400.047619:0:9513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047627:0:9513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047675:0:9513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.047685:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100400.047786:0:13715:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100400.047794:0:13715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100400.047801:0:13715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58c00/0xc87a4f2298286de8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100400.048856:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a237a43-d248-40fc-b145-fd7f23146511+20:3642:x1877056140961280:12345-0@lo:103:ldlm_bl.0 Request processed in 1533us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100400.048866:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790100400.051406:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140961280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100400.073691:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100400.073720:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140961408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100400.073783:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100400.073876:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140961408 00000100:00100000:0.0:1790100400.073884:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140961408 00000100:00100000:0.0:1790100400.073939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790100400.073948:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140961408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790100400.073980:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790100400.074035:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140961408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100400.074042:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790100400.074090:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140961408:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1790100400.955737:0:13764:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc655c09e0 20000000:00000080:2.0:1790100400.955753:0:13764:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff926083e68c00 uarg=0000000000000000 20000000:01000000:2.0:1790100400.955791:0:13764:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1790100400.955797:0:13764:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1790100400.955802:0:13764:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1790100400.961526:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1790100400.961760:0:13764:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1790100400.961842:0:13764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1790100400.961869:0:13764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1790100400.961883:0:13764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1790100400.961895:0:13764:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790100400.961977:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962481:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962496:0:13764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962517:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962523:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962531:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962538:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100400.962542:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962551:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962564:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962636:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100400.962644:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926200/0xc87a4f2298286def lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100400.970843:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100401.097514:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100401.099794:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140961536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100401.099860:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100401.099964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140961536 00000100:00100000:2.0:1790100401.099972:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140961536 00000100:00100000:2.0:1790100401.100024:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790100401.100032:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140961536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100401.100064:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100401.100125:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140961536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100401.100132:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790100401.100207:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140961536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100401.305124:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100401.305320:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127262080 00000100:00100000:3.0:1790100401.305331:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127262080 00000100:00100000:3.0:1790100401.305432:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 322 00000100:00100000:3.0:1790100401.305442:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:6184:x1877056127262080:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100401.305458:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100401.305475:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286df6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e10c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100401.305502:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286df6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e10c expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100401.305512:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286df6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e10c expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100401.305522:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e58000, rc 0) 00000100:00100000:3.0:1790100401.305626:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127262080:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 186us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100401.305634:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 322 00000100:00100000:2.0:1790100401.316497:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100401.316603:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127262208 00000100:00100000:0.0:1790100401.316614:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127262208 00000100:00100000:0.0:1790100401.316693:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 323 00000100:00100000:0.0:1790100401.316703:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127262208:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.316842:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127262208:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.316849:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 323 00000100:00100000:1.0:1790100401.321819:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100401.322477:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127262336 00000100:00100000:3.0:1790100401.322487:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127262336 00000100:00100000:3.0:1790100401.322543:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 324 00000100:00100000:3.0:1790100401.322553:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127262336:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100401.322786:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127262336:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 234us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100401.322804:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 324 00000100:00100000:2.0:1790100401.328377:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100401.328464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127262464 00000100:00100000:1.0:1790100401.328474:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127262464 00000100:00100000:1.0:1790100401.328526:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 325 00000100:00100000:1.0:1790100401.328536:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:10779:x1877056127262464:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100401.328682:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:10779:x1877056127262464:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 146us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.328690:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 325 00000100:00100000:2.0:1790100401.339275:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100401.339470:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127262592 00000100:00100000:0.0:1790100401.339480:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127262592 00000100:00100000:0.0:1790100401.339539:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 326 00000100:00100000:0.0:1790100401.339549:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:10779:x1877056127262592:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100401.339696:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:10779:x1877056127262592:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 148us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.339704:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 326 00000100:00100000:2.0:1790100401.350574:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100401.350655:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127262720 00000100:00100000:3.0:1790100401.350664:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127262720 00000100:00100000:3.0:1790100401.350718:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 327 00000100:00100000:3.0:1790100401.350727:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:6184:x1877056127262720:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100401.350741:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100401.350756:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286dfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e113 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100401.350781:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286dfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e113 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100401.350791:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286dfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e113 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100401.350799:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a2e59000, rc 0) 00000100:00100000:3.0:1790100401.350851:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127262720:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 125us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100401.350858:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 327 10000000:01000000:0.0:1790100401.352451:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100401.352458:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261a6449800 from 7 10000000:01000000:0.0:1790100401.352462:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100401.352500:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100401.352510:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100401.352536:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100401.352558:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140961664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.352606:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.352669:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.352796:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140961664 00000100:00100000:1.0:1790100401.352804:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140961664 00000100:00100000:1.0:1790100401.352848:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1790100401.352856:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+20:6510:x1877056140961664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100401.352866:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100401.352889:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286e0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286e04 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.352922:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286e04 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.352931:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286e04 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.352949:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6800, rc 0) 00000100:00100000:1.0:1790100401.352993:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140961664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.352999:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1790100401.353171:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140961664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100401.353185:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100401.353193:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100401.353253:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140961792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.353293:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.353321:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100401.353391:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140961792 00000100:00100000:2.0:1790100401.353396:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140961792 00000100:00100000:2.0:1790100401.353426:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1790100401.353434:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140961792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100401.353549:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140961792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100401.353556:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1790100401.353892:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140961792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.353940:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140961920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.353981:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.354010:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100401.354154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140961920 00000100:00100000:2.0:1790100401.354159:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140961920 00000100:00100000:2.0:1790100401.354191:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1790100401.354198:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140961920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100401.354281:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140961920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100401.354288:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1790100401.354748:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140961920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.355197:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13777:1877056140962048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100401.355233:0:13777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.355277:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100401.355438:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140962048 00000100:00100000:3.0:1790100401.355444:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140962048 00000100:00100000:3.0:1790100401.355480:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1790100401.355487:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+21:13777:x1877056140962048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100401.355572:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+21:13777:x1877056140962048:12345-0@lo:502:llog_process_th.0 Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100401.355580:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1790100401.355661:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13777:1877056140962048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100401.355683:0:13777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100401.355691:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100401.355694:0:13777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790100401.355700:0:13777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261a6449800 00000020:00000080:1.0:1790100401.355702:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100401.355763:0:13777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100401.355767:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100401.355768:0:13777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790100401.355770:0:13777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100401.355773:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100401.355774:0:13777:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790100401.355777:0:13777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261a6449800 00000020:00000080:1.0:1790100401.355779:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790100401.355810:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13777:1877056140962176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100401.355841:0:13777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.355862:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140962176 00000100:00100000:1.0:1790100401.355865:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140962176 00000100:00100000:1.0:1790100401.355895:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790100401.356152:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:13777:x1877056140962176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100401.356214:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:13777:x1877056140962176:12345-0@lo:502:llog_process_th.0 Request processed in 312us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.356228:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790100401.356467:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8c900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.356481:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13777:1877056140962176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100401.356498:0:13777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100401.356503:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100401.356504:0:13777:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790100401.356508:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790100401.356568:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790100401.356585:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100401.356593:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.356602:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100401.356611:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100401.356613:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b6950800 from 7 10000000:01000000:1.0:1790100401.356615:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100401.356637:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.356645:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.356653:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100401.356665:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140962304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.356691:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.356715:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8c900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.356727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140962304 00000100:00100000:1.0:1790100401.356730:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140962304 00000100:00100000:1.0:1790100401.356748:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790100401.356753:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+21:6510:x1877056140962304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100401.356762:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100401.356772:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7000/0xc87a4f2298286e19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286e12 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.356790:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7000/0xc87a4f2298286e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286e12 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.356798:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7000/0xc87a4f2298286e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286e12 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.356805:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7000, rc 0) 00000100:00100000:1.0:1790100401.356832:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140962304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.356837:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790100401.356863:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140962304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100401.359064:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.359080:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100401.359160:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140962432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.359213:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.359253:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8c900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100401.359460:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140962432 00000100:00100000:0.0:1790100401.359467:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140962432 00000100:00100000:0.0:1790100401.359509:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1790100401.359528:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140962432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.359633:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140962432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.359639:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1790100401.360642:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140962432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.360684:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140962560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.360734:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.360758:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8c900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100401.361607:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140962560 00000100:00100000:0.0:1790100401.361614:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140962560 00000100:00100000:0.0:1790100401.361661:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1790100401.361668:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140962560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.361770:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140962560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.361777:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1790100401.363073:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140962560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.366468:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13779:1877056140962688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100401.366546:0:13779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.366590:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140962688 00000100:00100000:1.0:1790100401.366596:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140962688 00000100:00100000:1.0:1790100401.366631:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1790100401.366638:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:13779:x1877056140962688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100401.366733:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+22:13779:x1877056140962688:12345-0@lo:502:llog_process_th.0 Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.366740:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1790100401.366784:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.366802:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13779:1877056140962688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100401.366825:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100401.366834:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100401.366836:0:13779:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790100401.366841:0:13779:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261b6950800 00000020:00000080:1.0:1790100401.366843:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100401.366883:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100401.366886:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100401.366888:0:13779:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790100401.366890:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100401.366897:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100401.366898:0:13779:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790100401.366902:0:13779:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261b6950800 00000020:00000080:1.0:1790100401.366904:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790100401.366930:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13779:1877056140962816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100401.366957:0:13779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.366976:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140962816 00000100:00100000:1.0:1790100401.366979:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140962816 00000100:00100000:1.0:1790100401.366997:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1790100401.367003:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:13779:x1877056140962816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100401.367054:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:13779:x1877056140962816:12345-0@lo:502:llog_process_th.0 Request processed in 51us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.367060:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1790100401.367085:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.367095:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13779:1877056140962816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100401.367109:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100401.367112:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100401.367114:0:13779:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790100401.367117:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790100401.367159:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790100401.367174:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100401.367183:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.367193:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100401.367203:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100401.367209:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b2026000 from 7 10000000:01000000:1.0:1790100401.367212:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100401.367233:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.367241:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.367249:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100401.367262:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140962944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.367287:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.367300:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.367311:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140962944 00000100:00100000:1.0:1790100401.367314:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140962944 00000100:00100000:1.0:1790100401.367335:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1790100401.367375:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+22:6510:x1877056140962944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100401.367384:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100401.367395:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286e27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286e20 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.367414:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286e20 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.367424:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286e20 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.367431:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6000, rc 0) 00000100:00100000:1.0:1790100401.367457:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140962944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.367467:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1790100401.367495:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140962944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100401.367506:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.367515:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100401.367551:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.367571:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.367582:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.367591:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140963072 00000100:00100000:1.0:1790100401.367594:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140963072 00000100:00100000:1.0:1790100401.367610:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1790100401.367615:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140963072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.367684:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140963072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.367690:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1790100401.367713:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.367732:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.367758:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.367769:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.367778:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140963200 00000100:00100000:1.0:1790100401.367780:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140963200 00000100:00100000:1.0:1790100401.367795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1790100401.367805:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140963200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.367855:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140963200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.367861:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1790100401.367889:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.368581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100401.368602:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127262848 00000100:00100000:0.0:1790100401.368607:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127262848 00000100:00100000:0.0:1790100401.368630:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 341 00000100:00100000:0.0:1790100401.368636:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127262848:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.368707:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127262848:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.368714:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 341 00000100:00100000:3.0:1790100401.377174:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100401.377596:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127262976 00000100:00100000:1.0:1790100401.377606:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127262976 00000100:00100000:1.0:1790100401.377652:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 342 00000100:00100000:1.0:1790100401.377661:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127262976:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100401.377778:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:6184:x1877056127262976:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 118us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.377786:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 342 00000100:00100000:1.0:1790100401.379964:0:13780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13780:1877056140963328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100401.380038:0:13780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.380081:0:13780:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b8c840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100401.380220:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140963328 00000100:00100000:0.0:1790100401.380228:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140963328 00000100:00100000:0.0:1790100401.380278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1790100401.380287:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:13780:x1877056140963328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100401.380446:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+23:13780:x1877056140963328:12345-0@lo:502:llog_process_th.0 Request processed in 160us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.380454:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1790100401.380602:0:13780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13780:1877056140963328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790100401.380628:0:13780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100401.380637:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100401.380639:0:13780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790100401.380646:0:13780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261b2026000 00000020:00000080:3.0:1790100401.380650:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100401.380701:0:13780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100401.380705:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100401.380706:0:13780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790100401.380710:0:13780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100401.380712:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100401.380713:0:13780:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790100401.380717:0:13780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261b2026000 00000020:00000080:3.0:1790100401.380719:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790100401.380753:0:13780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13780:1877056140963456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100401.380790:0:13780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100401.380813:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140963456 00000100:00100000:3.0:1790100401.380817:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140963456 00000100:00100000:3.0:1790100401.380839:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1790100401.380845:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:13780:x1877056140963456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100401.380918:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+23:13780:x1877056140963456:12345-0@lo:502:llog_process_th.0 Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100401.380925:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1790100401.380951:0:13780:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082ab0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100401.380964:0:13780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13780:1877056140963456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790100401.380982:0:13780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100401.380987:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100401.380993:0:13780:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790100401.380997:0:13780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790100401.382585:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1790100401.382616:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100401.382626:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100401.382637:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100401.382647:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100401.382649:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926187007800 from 7 10000000:01000000:0.0:1790100401.382652:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100401.382682:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100401.382690:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100401.382698:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100401.382717:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.382761:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.383166:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd540 going to sleep for 11 seconds 00000100:00100000:1.0:1790100401.384073:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140963584 00000100:00100000:1.0:1790100401.384082:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140963584 00000100:00100000:1.0:1790100401.384125:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1790100401.384134:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+23:6510:x1877056140963584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100401.384149:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100401.384164:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298286e35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298286e2e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.384188:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298286e35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298286e2e expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.384215:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298286e35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298286e2e expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100401.384224:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7a00, rc 0) 00000100:00100000:1.0:1790100401.384295:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140963584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.384301:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1790100401.384613:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100401.384629:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100401.384645:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100401.384711:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.384743:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.384766:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100401.385984:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140963712 00000100:00100000:0.0:1790100401.385992:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140963712 00000100:00100000:0.0:1790100401.386030:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1790100401.386038:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140963712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.386156:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140963712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.386163:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1790100401.386205:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.386238:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.386288:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.386316:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140963840 00000100:00100000:0.0:1790100401.386320:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140963840 00000100:00100000:0.0:1790100401.386354:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790100401.386360:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140963840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.386436:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:6510:x1877056140963840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.386442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790100401.386477:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100401.386494:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a237a43-d248-40fc-b145-fd7f23146511:6510:1877056140963840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100401.386701:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13782:1877056140963968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100401.386732:0:13782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.386749:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140963968 00000100:00100000:0.0:1790100401.386753:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140963968 00000100:00100000:0.0:1790100401.386773:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1790100401.386779:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:13782:x1877056140963968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100401.386846:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:13782:x1877056140963968:12345-0@lo:502:llog_process_th.0 Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.386852:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1790100401.386893:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100401.386905:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13782:1877056140963968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100401.386925:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100401.386932:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100401.386934:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790100401.386940:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff926187007800 00000020:00000080:0.0:1790100401.386942:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790100401.386989:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100401.387278:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100401.387281:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790100401.387285:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100401.387288:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100401.387290:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790100401.387293:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff926187007800 00000020:00000080:0.0:1790100401.387295:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790100401.387511:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13782:1877056140964096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100401.387544:0:13782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.387570:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140964096 00000100:00100000:0.0:1790100401.387575:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140964096 00000100:00100000:0.0:1790100401.387596:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1790100401.387602:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:13782:x1877056140964096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100401.387661:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:13782:x1877056140964096:12345-0@lo:502:llog_process_th.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.387668:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1790100401.387696:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100401.387708:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a237a43-d248-40fc-b145-fd7f23146511:13782:1877056140964096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100401.387723:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100401.387726:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100401.387728:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790100401.387732:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790100401.387783:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1790100401.387803:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100401.387812:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100401.387822:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100401.392386:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100401.392833:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127263104 00000100:00100000:0.0:1790100401.392843:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127263104 00000100:00100000:0.0:1790100401.392917:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 350 00000100:00100000:0.0:1790100401.392927:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:10782:x1877056127263104:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100401.393054:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:10782:x1877056127263104:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 128us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.393063:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 350 00000040:00080000:2.0:1790100401.401235:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790100401.401493:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100401.401527:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127263232 00000100:00100000:1.0:1790100401.401536:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127263232 00000100:00100000:1.0:1790100401.401581:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 351 00000100:00100000:1.0:1790100401.401590:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:10782:x1877056127263232:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100401.401715:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:10782:x1877056127263232:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 126us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.401722:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 351 00000040:00080000:3.0:1790100401.432681:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790100401.608647:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100401.608669:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140964224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100401.608735:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100401.608834:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100401.608849:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140964352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100401.609071:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140964480:0@lo:400:kworker.0 00000100:00100000:0.0:1790100401.609136:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140964608:0@lo:400:kworker.0 00000100:00100000:3.0:1790100401.609744:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140964224 00000100:00100000:3.0:1790100401.609752:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140964224 00000100:00100000:3.0:1790100401.609803:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790100401.609814:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140964224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100401.609840:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100401.609981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.610008:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140964992:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.610026:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.610042:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140965504:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.610059:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.610096:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140964480 00000100:00100000:1.0:1790100401.610099:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140964480 00000100:00100000:1.0:1790100401.610124:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140964992 00000100:00100000:1.0:1790100401.610126:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140964992 00000100:00100000:1.0:1790100401.610151:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140965504 00000100:00100000:1.0:1790100401.610154:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140965504 00000100:00100000:1.0:1790100401.610166:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790100401.610172:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140964480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.610210:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140964480:12345-0@lo:400:kworker.0 Request processed in 39us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.610217:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790100401.610233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790100401.610239:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140964992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.612433:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140964992:12345-0@lo:400:kworker.0 Request processed in 22us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.612452:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790100401.612486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790100401.612499:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140965504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.612568:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140965504:12345-0@lo:400:kworker.0 Request processed in 75us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.612574:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790100401.612678:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140964480:0@lo:400:kworker.0 00010000:00080000:1.0:1790100401.612692:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63ff480 x1877056140964992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100401.612825:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140964992:0@lo:400:kworker.0 00010000:00080000:1.0:1790100401.612840:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b2571f80 x1877056140965504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100401.612848:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140965504:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.612900:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140964864:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.612935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.612971:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140965376:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.612989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.613009:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790100401.613015:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140964736:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.613031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.613045:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140965248:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.613063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.613090:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140965248 00000100:00100000:1.0:1790100401.613096:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140965248 00000100:00100000:1.0:1790100401.613253:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790100401.613270:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140965248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.613307:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140965248:12345-0@lo:400:kworker.0 Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.613314:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790100401.613472:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140964864 00000100:00100000:1.0:1790100401.613477:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140964864 00000100:00100000:1.0:1790100401.613495:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140965376 00000100:00100000:1.0:1790100401.613497:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140965376 00000100:00100000:1.0:1790100401.613508:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140964736 00000100:00100000:1.0:1790100401.613510:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140964736 00000100:00100000:1.0:1790100401.613521:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790100401.613527:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140964864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.613556:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140964864:12345-0@lo:400:kworker.0 Request processed in 30us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.613562:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790100401.613579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790100401.614769:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140965376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.614826:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140965376:12345-0@lo:400:kworker.0 Request processed in 1240us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.614836:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790100401.614858:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790100401.614866:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140964736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.614891:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140964736:12345-0@lo:400:kworker.0 Request processed in 27us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.614897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790100401.614939:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140964736:0@lo:400:kworker.0 00010000:00080000:1.0:1790100401.614951:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b2572a00 x1877056140965248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100401.614961:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140965248:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.614971:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140964864:0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.614979:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140965376:0@lo:400:kworker.0 00000100:00080000:1.0:1790100401.615660:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790100401.615666:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100401.615669:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100401.615672:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100401.619189:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.619249:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140965120:0@lo:400:kworker.0 00000100:00100000:0.0:1790100401.619281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.619308:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140965632:0@lo:400:kworker.0 00000100:00100000:0.0:1790100401.619330:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100401.619378:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140965120 00000100:00100000:0.0:1790100401.619386:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140965120 00000100:00100000:0.0:1790100401.620357:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140965632 00000100:00100000:0.0:1790100401.620372:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140965632 00000100:00100000:0.0:1790100401.620421:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790100401.620430:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140965120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100401.620498:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140965120:12345-0@lo:400:kworker.0 Request processed in 70us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.620506:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790100401.620521:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790100401.620527:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140965632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100401.620550:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140965632:12345-0@lo:400:kworker.0 Request processed in 24us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.620555:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1790100401.620572:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100401.620575:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790100401.620606:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b2570700 x1877056140965632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100401.620636:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140965632:0@lo:400:kworker.0 00010000:00080000:0.0:1790100401.620660:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b2570a80 x1877056140965120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100401.620668:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140965120:0@lo:400:kworker.0 00000100:00100000:2.0:1790100401.622076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100401.622102:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140964608 00000100:00100000:1.0:1790100401.622111:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140964608 00000100:00100000:1.0:1790100401.622149:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790100401.622157:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140964608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100401.622216:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140964608:12345-0@lo:400:kworker.0 Request processed in 61us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100401.622231:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790100401.622553:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140964352 00000100:00100000:0.0:1790100401.622558:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140964352 00000100:00100000:0.0:1790100401.622630:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100401.622640:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140964352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100401.622657:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100401.622673:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140964608:0@lo:400:kworker.0 00000100:00100000:0.0:1790100401.622702:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140964352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100401.622710:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1790100401.622721:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261bccb1180 x1877056140964352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100401.622735:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140964352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100401.622816:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140964224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13003us (14079us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100401.622825:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1790100401.622847:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6254000 x1877056140964224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100401.622863:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140964224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790100401.995080:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100402.440993:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1790100402.441856:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00080000:0.0:1790100402.635557:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1790100402.635600:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1790100402.635610:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1790100402.635682:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635695:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635703:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635709:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100402.635713:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635720:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635737:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff926187044500) 00010000:00010000:1.0:1790100402.635740:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100402.635744:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635750:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286d40 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635767:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635780:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635785:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635790:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100402.635793:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635798:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635806:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9261c1af1400) 00010000:00010000:1.0:1790100402.635808:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100402.635811:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635816:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298286d55 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635834:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635839:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635845:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635850:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100402.635859:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635865:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635872:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff926187044500) 00010000:00010000:1.0:1790100402.635874:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100402.635876:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635882:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286dbe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635895:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635901:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635907:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635912:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100402.635915:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635920:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635926:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9261b209b300) 00010000:00010000:1.0:1790100402.635929:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100402.635935:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100402.635941:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298286dda lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100402.636129:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100402.636146:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140965760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790100402.636203:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100402.636640:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140965760 00000100:00100000:2.0:1790100402.636648:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140965760 00000100:00100000:2.0:1790100402.636692:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100402.636701:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140965760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790100402.636722:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1790100402.636749:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6ab2c3ab, atime: 0x6ab2c3ab, ctime: 0x6ab2c3ab, blocks: 0x0 00010000:00010000:2.0:1790100402.636755:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100402.636768:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=253s v=(0 0) 00010000:00010000:2.0:1790100402.636772:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100402.636778:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100402.636792:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100402.636800:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100402.636806:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100402.636903:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790100402.637038:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1877056140965760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 337us (833us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790100402.637045:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1790100402.637110:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff926083b5ea00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1790100402.637115:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140965760:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790100402.639542:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100402.639554:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100402.639568:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100402.639572:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100402.639582:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100402.639607:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100402.639614:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4e63b2/0xc87a4f2298286e3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100402.639651:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100402.639654:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100402.639656:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100403.019421:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100403.548724:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100403.548813:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127263360 00000100:00100000:3.0:1790100403.548824:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127263360 00000100:00100000:3.0:1790100403.548879:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 352 00000100:00100000:3.0:1790100403.548889:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127263360:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100403.548957:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127263360:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100403.548964:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 352 00000100:00100000:3.0:1790100403.554061:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100403.554215:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127263488 00000100:00100000:1.0:1790100403.554225:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127263488 00000100:00100000:1.0:1790100403.554312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:1.0:1790100403.554323:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127263488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100403.554442:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127263488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100403.554450:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00080000:0.0:1790100403.554563:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100403.580750:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100403.580797:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100403.580830:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100403.580860:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100403.580933:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127263616 00000100:00100000:3.0:1790100403.580943:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127263616 00000100:00100000:3.0:1790100403.580997:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127263872 00000100:00100000:3.0:1790100403.581001:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127263872 00000100:00100000:3.0:1790100403.581020:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127264000 00000100:00100000:3.0:1790100403.581023:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127264000 00000100:00100000:3.0:1790100403.581040:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:3.0:1790100403.581050:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127263616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100403.581114:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127263616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 65us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100403.581121:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:3.0:1790100403.581137:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:3.0:1790100403.581145:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127263872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100403.581191:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127263872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100403.581198:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:3.0:1790100403.581211:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:3.0:1790100403.581217:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127264000:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100403.581241:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127264000:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100403.581247:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1790100403.581594:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127263744 00000100:00100000:1.0:1790100403.581599:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127263744 00000100:00100000:1.0:1790100403.581639:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1790100403.581647:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127263744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100403.581688:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127263744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100403.581695:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00080000:0.0:1790100403.581990:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100403.581995:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100403.581997:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1790100404.040576:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100404.680604:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140965888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100404.680672:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100404.680827:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140965888 00000100:00100000:0.0:1790100404.680835:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140965888 00000100:00100000:0.0:1790100404.680902:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790100404.680911:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140965888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100404.680947:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100404.680991:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140965888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100404.680998:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1790100404.681123:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100404.681164:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140965888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100404.682484:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140966016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100404.682531:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100404.682581:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140966016 00000100:00100000:3.0:1790100404.682588:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140966016 00000100:00080000:2.0:1790100404.682634:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100404.682639:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790100404.682649:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140966016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100404.682665:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100404.688381:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140966016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5689us (5803us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100404.688397:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790100404.692161:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140966016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100405.065273:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100405.192643:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140966144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100405.192719:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100405.192883:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140966144 00000100:00100000:3.0:1790100405.192891:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140966144 00000100:00100000:3.0:1790100405.192948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790100405.192957:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140966144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100405.192988:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790100405.193039:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140966144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100405.193046:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790100405.193259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140966144:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790100406.088549:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100406.218762:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100406.218783:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140966272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100406.218855:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100406.219042:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140966272 00000100:00100000:3.0:1790100406.219050:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140966272 00000100:00100000:3.0:1790100406.219098:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790100406.219106:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140966272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790100406.219135:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790100406.219179:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140966272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100406.219186:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790100406.219265:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140966272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100406.728987:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140966528:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.729055:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100406.729112:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140967040:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.729134:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100406.729154:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140967552:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.729174:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100406.729198:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790100406.729205:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140966656:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.729227:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100406.729243:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140967168:0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.729556:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140966528 00000100:00100000:2.0:1790100406.729575:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140966528 00000100:00100000:2.0:1790100406.729619:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140967040 00000100:00100000:2.0:1790100406.729623:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140967040 00000100:00100000:2.0:1790100406.729646:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140967552 00000100:00100000:2.0:1790100406.729649:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140967552 00000100:00100000:2.0:1790100406.729665:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790100406.729673:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140966528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.729723:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140966528:12345-0@lo:400:kworker.0 Request processed in 50us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100406.729729:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790100406.729745:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790100406.729751:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140967040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.729777:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140967040:12345-0@lo:400:kworker.0 Request processed in 27us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100406.729783:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790100406.729794:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790100406.729800:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140967552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.729839:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140967552:12345-0@lo:400:kworker.0 Request processed in 39us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100406.729846:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790100406.729868:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140966656 00000100:00100000:2.0:1790100406.729872:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140966656 00000100:00100000:2.0:1790100406.729894:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790100406.729900:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140966656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.729933:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140966656:12345-0@lo:400:kworker.0 Request processed in 33us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100406.729940:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1790100406.729982:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100406.729993:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140966400:0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730023:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100406.730048:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140966912:0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730073:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100406.730091:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140967424:0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730114:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100406.730130:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140967936:0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100406.730169:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790100406.730176:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140966784:0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730202:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140966912 00000100:00100000:2.0:1790100406.730206:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140966912 00000100:00100000:2.0:1790100406.730228:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790100406.730234:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140966912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730278:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140966912:12345-0@lo:400:kworker.0 Request processed in 43us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100406.730285:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790100406.730572:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140967424 00000100:00100000:2.0:1790100406.730577:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140967424 00000100:00100000:2.0:1790100406.730606:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140967936 00000100:00100000:2.0:1790100406.730610:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140967936 00000100:00100000:2.0:1790100406.730629:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790100406.730636:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1877056140967424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730669:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1877056140967424:12345-0@lo:400:kworker.0 Request processed in 33us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100406.730675:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790100406.730687:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790100406.730693:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140967936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730718:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140967936:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100406.730724:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1790100406.730745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100406.730748:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100406.730778:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100406.730787:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140968064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100406.730812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100406.730863:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140966400 00000100:00100000:2.0:1790100406.730868:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140966400 00000100:00100000:2.0:1790100406.730891:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1790100406.730898:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140966400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100406.730933:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140966400:12345-0@lo:400:kworker.0 Request processed in 35us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100406.730946:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1790100406.731210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100406.731240:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140967680:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.731265:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100406.731299:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140966528:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.731311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140967040:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.731355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140967552:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.731381:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140966656:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.731397:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140967168 00000100:00100000:1.0:1790100406.731400:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140967168 00000100:00100000:1.0:1790100406.731429:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140967680 00000100:00100000:1.0:1790100406.731432:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140967680 00000100:00100000:1.0:1790100406.731446:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790100406.731453:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140967168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.731488:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140967168:12345-0@lo:400:kworker.0 Request processed in 35us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100406.731625:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140968064 00000100:00100000:0.0:1790100406.731629:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140968064 00000100:00100000:0.0:1790100406.731658:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790100406.731665:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140968064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100406.731683:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100406.731714:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140968064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100406.731720:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790100406.731742:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140968192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100406.731764:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790100406.731789:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5d880 x1877056140968064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100406.731803:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140968064:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790100406.731831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100406.731835:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100406.731845:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100406.731867:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140967296:0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.731890:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100406.731906:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140967808:0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.731926:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100406.731948:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140966400:0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.731959:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140966912:0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.731969:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140967424:0@lo:400:kworker.0 00010000:00080000:0.0:1790100406.731978:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ecb480 x1877056140967936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100406.731987:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140967936:0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.732010:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140967296 00000100:00100000:0.0:1790100406.732014:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140967296 00000100:00100000:0.0:1790100406.732040:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140967808 00000100:00100000:0.0:1790100406.732044:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140967808 00000100:00100000:0.0:1790100406.732060:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790100406.732066:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140967296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.732099:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140967296:12345-0@lo:400:kworker.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100406.732105:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790100406.732116:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790100406.732122:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140967808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.732149:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140967808:12345-0@lo:400:kworker.0 Request processed in 26us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100406.732155:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1790100406.732180:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100406.732191:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140966784 00000100:00100000:0.0:1790100406.732194:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140966784 00000100:00100000:0.0:1790100406.732211:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790100406.732216:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140967680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.732245:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140967680:12345-0@lo:400:kworker.0 Request processed in 29us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100406.732251:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790100406.732264:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790100406.732270:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140966784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.732297:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140966784:12345-0@lo:400:kworker.0 Request processed in 27us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100406.732303:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790100406.732371:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140966784:0@lo:400:kworker.0 00000100:00100000:0.0:1790100406.732385:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140967296:0@lo:400:kworker.0 00010000:00080000:0.0:1790100406.732394:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b73b80 x1877056140967808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100406.732402:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140967808:0@lo:400:kworker.0 00010000:00080000:0.0:1790100406.732473:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b2570700 x1877056140967168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100406.732482:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140967168:0@lo:400:kworker.0 00010000:00080000:0.0:1790100406.732492:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63ff480 x1877056140967680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100406.732513:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140967680:0@lo:400:kworker.0 00000100:00100000:1.0:1790100406.733017:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790100406.733141:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140968192 00000100:00100000:3.0:1790100406.733146:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140968192 00000100:00100000:3.0:1790100406.733171:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790100406.733177:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140968192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100406.733191:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100406.733242:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140968192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100406.733248:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1790100406.733815:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ec5f80 x1877056140968192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100406.733832:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140968192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790100407.112611:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100408.136531:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100408.663860:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100408.663902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100408.663935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100408.663965:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100408.663984:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100408.664034:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100408.664077:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127264256 00000100:00100000:0.0:1790100408.664087:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127264256 00000100:00100000:0.0:1790100408.664142:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127264768 00000100:00100000:0.0:1790100408.664146:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127264768 00000100:00100000:0.0:1790100408.664160:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127264384 00000100:00100000:0.0:1790100408.664162:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127264384 00000100:00100000:0.0:1790100408.664173:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127264640 00000100:00100000:0.0:1790100408.664175:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127264640 00000100:00100000:0.0:1790100408.664188:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1790100408.664196:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127264256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100408.664278:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127264256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 82us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100408.664285:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1790100408.664302:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:0.0:1790100408.664308:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127264768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100408.664382:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127264768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100408.664389:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:0.0:1790100408.664401:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:0.0:1790100408.664407:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127264384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100408.664444:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127264384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100408.664450:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:0.0:1790100408.664462:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:0.0:1790100408.664469:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127264640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100408.664506:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127264640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100408.664512:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00080000:0.0:1790100408.664529:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100408.664533:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100408.664822:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127264512 00000100:00100000:1.0:1790100408.664827:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127264512 00000100:00100000:1.0:1790100408.664875:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:1.0:1790100408.664881:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127264512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100408.664908:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127264512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100408.664914:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:1.0:1790100408.664933:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127264128 00000100:00100000:1.0:1790100408.664936:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127264128 00000100:00100000:1.0:1790100408.664957:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 354 00000100:00100000:1.0:1790100408.664963:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2419:x1877056127264128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100408.665007:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2419:x1877056127264128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100408.665015:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 354 00000100:00080000:0.0:1790100408.665809:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790100408.778420:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:3.0:1790100409.166669:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100409.800685:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100409.800707:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140968320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790100409.800830:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100409.800849:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100409.800937:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140968448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100409.800967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100409.802165:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140968320 00000100:00100000:0.0:1790100409.802174:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140968448 00000100:00100000:2.0:1790100409.802175:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140968320 00000100:00100000:0.0:1790100409.802178:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140968448 00000100:00100000:0.0:1790100409.802280:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790100409.802290:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140968448:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790100409.802318:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1790100409.802327:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100409.802384:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790100409.802392:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140968320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790100409.802403:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100409.802464:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1790100409.802469:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff926083b5ea00, transno 4294967301 00000100:00100000:1.0:1790100409.802489:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140968448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100409.802494:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140968448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100409.802500:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790100409.802780:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140968320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 388us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100409.802787:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790100409.803081:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140968320:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790100410.184967:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100410.313166:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140968576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100410.313232:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100410.314049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140968576 00000100:00100000:2.0:1790100410.314058:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140968576 00000100:00100000:2.0:1790100410.314104:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790100410.314111:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140968576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100410.314142:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790100410.314208:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140968576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100410.314217:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790100410.314260:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140968576:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790100411.210505:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100411.336683:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100411.336702:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140968704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100411.336759:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100411.337083:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140968704 00000100:00100000:3.0:1790100411.337091:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140968704 00000100:00100000:3.0:1790100411.337136:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790100411.337143:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140968704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790100411.337172:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790100411.337239:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140968704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100411.337246:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790100411.337378:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140968704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100411.852116:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140968960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100411.852190:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852205:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140969088:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.852247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100411.852273:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140969472:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.852275:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140969600:0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.852325:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852328:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852380:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140970112:0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.852386:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140969984:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.852406:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100411.852434:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852440:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790100411.852461:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140969216:0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.852470:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140970496:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.852490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100411.852506:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852514:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140969728:0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.852531:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1790100411.852541:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140968832:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.852542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852573:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140970240:0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.852581:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100411.852612:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140969344:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.852641:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140969088 00000100:00100000:2.0:1790100411.852642:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852650:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140969088 00000100:00100000:2.0:1790100411.852658:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140969856:0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.852683:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852693:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140969600 00000100:00100000:1.0:1790100411.852698:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140969600 00000100:00100000:2.0:1790100411.852705:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140970368:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.852725:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140970112 00000100:00100000:1.0:1790100411.852729:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140970112 00000100:00100000:2.0:1790100411.852735:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100411.852748:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140969728 00000100:00100000:1.0:1790100411.852752:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140969728 00000100:00100000:1.0:1790100411.852768:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140970240 00000100:00100000:1.0:1790100411.852771:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140970240 00000100:00100000:1.0:1790100411.852784:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140969344 00000100:00100000:1.0:1790100411.852787:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140969344 00000100:00100000:2.0:1790100411.852791:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140969984 00000100:00100000:2.0:1790100411.852797:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140969984 00000100:00100000:1.0:1790100411.852805:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790100411.852817:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140969088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.852827:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140970496 00000100:00100000:2.0:1790100411.852832:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140970496 00000100:00100000:2.0:1790100411.852847:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140969856 00000100:00100000:2.0:1790100411.852850:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140969856 00000100:00100000:2.0:1790100411.852870:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140970368 00000100:00100000:2.0:1790100411.852872:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140970368 00000100:00100000:1.0:1790100411.852876:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140969088:12345-0@lo:400:kworker.0 Request processed in 60us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100411.852886:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790100411.852893:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790100411.852904:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140969984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.852910:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790100411.852921:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140969600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.852955:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140969984:12345-0@lo:400:kworker.0 Request processed in 53us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100411.852962:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140969600:12345-0@lo:400:kworker.0 Request processed in 41us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100411.852967:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100411.852974:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790100411.852990:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790100411.852995:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790100411.853005:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140970496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.853007:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140970112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.853044:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140970112:12345-0@lo:400:kworker.0 Request processed in 41us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100411.853054:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140970496:12345-0@lo:400:kworker.0 Request processed in 53us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100411.853063:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790100411.853075:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790100411.853082:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790100411.853090:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140969728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.853096:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790100411.853107:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140969856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.853125:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140969728:12345-0@lo:400:kworker.0 Request processed in 35us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100411.853133:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790100411.853150:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790100411.853151:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140969856:12345-0@lo:400:kworker.0 Request processed in 44us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100411.853159:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140970240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.853162:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790100411.853181:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790100411.853191:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140970368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.853197:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140970240:12345-0@lo:400:kworker.0 Request processed in 38us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100411.853205:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790100411.853220:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790100411.853229:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140969344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.853234:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140970368:12345-0@lo:400:kworker.0 Request processed in 43us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100411.853242:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790100411.853264:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140969344:12345-0@lo:400:kworker.0 Request processed in 36us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100411.853272:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1790100411.853302:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100411.853304:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140969344:0@lo:400:kworker.0 00000100:00080000:1.0:1790100411.853307:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100411.853313:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100411.853316:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100411.853322:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140969856:0@lo:400:kworker.0 00010000:00080000:2.0:1790100411.853362:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ecb480 x1877056140970368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1790100411.853368:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ec8a80 x1877056140969728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100411.853380:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140970368:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.853386:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140969728:0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.853400:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140969984:0@lo:400:kworker.0 00010000:00080000:1.0:1790100411.853405:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ec8700 x1877056140970240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1790100411.853418:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083eca680 x1877056140970496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100411.853441:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140970240:0@lo:400:kworker.0 00000100:00100000:2.0:1790100411.853444:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140970496:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.853462:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140969088:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.853477:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140969600:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.853488:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140970112:0@lo:400:kworker.0 00000100:00100000:3.0:1790100411.853737:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140969472 00000100:00100000:3.0:1790100411.853742:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140969472 00000100:00100000:3.0:1790100411.853779:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140969216 00000100:00100000:3.0:1790100411.853783:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140969216 00000100:00100000:3.0:1790100411.853799:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790100411.853805:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140969472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100411.853853:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140969472:12345-0@lo:400:kworker.0 Request processed in 47us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100411.853861:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790100411.853873:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790100411.853879:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140969216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100411.853911:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140969216:12345-0@lo:400:kworker.0 Request processed in 32us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100411.853917:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790100411.853937:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140968832 00000100:00100000:3.0:1790100411.853940:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140968832 00000100:00100000:3.0:1790100411.853963:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1790100411.853969:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140968832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100411.853997:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140968832:12345-0@lo:400:kworker.0 Request processed in 28us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100411.854004:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1790100411.854039:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140969216:0@lo:400:kworker.0 00000100:00100000:0.0:1790100411.854159:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140968960 00000100:00100000:0.0:1790100411.854163:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140968960 00000100:00100000:0.0:1790100411.854205:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790100411.854213:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140968960:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100411.854225:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:0.0:1790100411.854236:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100411.854268:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140968960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100411.854274:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790100411.855657:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140970624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100411.855732:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100411.855846:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140970624 00000100:00100000:0.0:1790100411.855853:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140970624 00000100:00100000:0.0:1790100411.855904:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790100411.855913:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140970624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100411.855936:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100411.855978:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140970624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100411.855985:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1790100411.856037:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ec4700 x1877056140970624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100411.856053:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140970624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100411.857336:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140968832:0@lo:400:kworker.0 00000100:00100000:1.0:1790100411.857393:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140969472:0@lo:400:kworker.0 00010000:00080000:1.0:1790100411.857407:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083b5f480 x1877056140968960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100411.857423:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140968960:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1790100412.232603:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100412.681085:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790100412.682243:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790100413.258723:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100413.784657:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100413.784704:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100413.784749:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100413.784782:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100413.784785:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127264896 00000100:00100000:2.0:1790100413.784796:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127264896 00000100:00100000:3.0:1790100413.784810:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100413.784814:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127265280 00000100:00100000:1.0:1790100413.784819:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127265280 00000100:00100000:2.0:1790100413.784856:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 356 00000100:00100000:2.0:1790100413.784868:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127264896:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100413.784874:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:3.0:1790100413.784879:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100413.784885:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127265280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100413.784903:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127265024 00000100:00100000:3.0:1790100413.784907:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127265024 00000100:00100000:1.0:1790100413.784943:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127265280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 59us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100413.784950:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00080000:1.0:1790100413.784984:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790100413.784989:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100413.784997:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127265536 00000100:00100000:1.0:1790100413.785000:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127265536 00000100:00100000:3.0:1790100413.785025:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127265408 00000100:00100000:1.0:1790100413.785025:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127265152 00000100:00100000:3.0:1790100413.785029:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127265408 00000100:00100000:1.0:1790100413.785039:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127265152 00000100:00100000:3.0:1790100413.785047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:3.0:1790100413.785054:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127265536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100413.785055:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:1.0:1790100413.785060:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127265024:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100413.786989:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127264896:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 2113us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100413.787002:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 356 00000100:00100000:2.0:1790100413.787074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:2.0:1790100413.787087:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127265408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100413.787139:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127265408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 56us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100413.787146:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:2.0:1790100413.787164:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:2.0:1790100413.787172:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127265152:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100413.787197:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127265152:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100413.787203:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00080000:2.0:1790100413.787770:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100413.787775:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790100413.797321:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127265536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 12255us (12527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100413.797353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:1.0:1790100413.808584:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127265024:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23510us (23866us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100413.808600:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00010000:00010000:3.0:1790100414.280732:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100414.920825:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140970752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100414.920893:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100414.920983:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140970880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790100414.921116:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100414.921224:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140970752 00000100:00100000:2.0:1790100414.921232:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140970752 00000100:00100000:0.0:1790100414.921255:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140970880 00000100:00100000:0.0:1790100414.921261:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140970880 00000100:00100000:0.0:1790100414.921563:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790100414.921579:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140970880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100414.921609:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100414.921621:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790100414.921633:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140970752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100414.921661:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100414.921661:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140970880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100414.921682:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790100414.921707:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140970752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100414.921715:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790100414.921734:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140970880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100414.921756:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140970752:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790100414.921814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790100415.304611:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100415.433072:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100415.433094:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140971008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100415.433155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100415.433290:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140971008 00000100:00100000:3.0:1790100415.433298:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140971008 00000100:00100000:3.0:1790100415.433356:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790100415.433364:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140971008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100415.433391:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790100415.433443:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140971008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100415.433450:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790100415.433633:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140971008:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790100416.328547:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100416.457635:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100416.457657:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140971136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100416.457731:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100416.457932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140971136 00000100:00100000:0.0:1790100416.457939:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140971136 00000100:00100000:0.0:1790100416.457984:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790100416.457993:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140971136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790100416.458023:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790100416.458074:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140971136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100416.458081:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790100416.458178:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140971136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100416.974886:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140971264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100416.974958:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100416.975094:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140971264 00000100:00100000:0.0:1790100416.975111:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140971264 00000100:00100000:0.0:1790100416.975169:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790100416.975178:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140971264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100416.975205:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100416.975249:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140971264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100416.975268:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790100416.975326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140971392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100416.975368:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100416.975404:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140971392 00000100:00100000:0.0:1790100416.975408:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140971392 00000100:00100000:0.0:1790100416.975442:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790100416.975449:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140971392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100416.975459:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100416.975503:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140971392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100416.975509:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1790100416.975541:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ec5f80 x1877056140971392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100416.975558:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140971392:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1790100416.975585:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ec4700 x1877056140971264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100416.975596:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140971264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100416.975832:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140971520:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.975865:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100416.975887:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140972032:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.975909:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100416.975926:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140972544:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.975946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100416.975963:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790100416.975969:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140971904:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.975991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100416.976007:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140972416:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976026:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100416.976050:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140972544 00000100:00100000:2.0:1790100416.976053:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140972544 00000100:00100000:2.0:1790100416.976080:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140972416 00000100:00100000:2.0:1790100416.976083:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140972416 00000100:00100000:2.0:1790100416.976111:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790100416.976117:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140972544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976155:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140972544:12345-0@lo:400:kworker.0 Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100416.976160:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790100416.976173:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790100416.976178:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140972416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976203:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140972416:12345-0@lo:400:kworker.0 Request processed in 25us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100416.976208:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790100416.976228:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140972032 00000100:00100000:2.0:1790100416.976232:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140972032 00000100:00100000:2.0:1790100416.976268:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790100416.976275:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140972032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976305:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140972032:12345-0@lo:400:kworker.0 Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100416.976311:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790100416.976333:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140971904 00000100:00100000:2.0:1790100416.976336:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140971904 00000100:00100000:2.0:1790100416.976383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790100416.976389:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140971904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976417:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140971904:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100416.976533:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790100416.976565:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140971904:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976573:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140972416:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976592:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140972032:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976599:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140972544:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976625:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140971776:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976648:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100416.976663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056140972288:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.976683:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790100416.976800:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100416.976804:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100416.976834:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140972288 00000100:00100000:1.0:1790100416.976838:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140972288 00000100:00100000:1.0:1790100416.976868:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790100416.976874:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056140972288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.976946:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140971648:0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.976974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100416.976993:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140972160:0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977013:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100416.977031:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140972672:0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100416.977080:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140971520 00000100:00100000:3.0:1790100416.977084:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140971520 00000100:00100000:3.0:1790100416.977111:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1790100416.977117:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140971520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977151:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140971520:12345-0@lo:400:kworker.0 Request processed in 34us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100416.977158:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1790100416.977184:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140971648 00000100:00100000:3.0:1790100416.977188:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140971648 00000100:00100000:3.0:1790100416.977202:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140972160 00000100:00100000:3.0:1790100416.977204:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140972160 00000100:00100000:3.0:1790100416.977214:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140972672 00000100:00100000:3.0:1790100416.977217:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140972672 00000100:00100000:3.0:1790100416.977229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790100416.977235:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140971648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977276:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140971648:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100416.977282:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790100416.977294:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1790100416.977299:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140972160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977322:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140972160:12345-0@lo:400:kworker.0 Request processed in 24us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100416.977335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1790100416.977368:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790100416.977374:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140972672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977402:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140972672:12345-0@lo:400:kworker.0 Request processed in 29us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100416.977407:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790100416.977844:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140971648:0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977855:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140972160:0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977863:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140972672:0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977886:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140971776 00000100:00100000:3.0:1790100416.977890:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140971776 00000100:00100000:3.0:1790100416.977915:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790100416.977922:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140971776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.977954:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140971776:12345-0@lo:400:kworker.0 Request processed in 33us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100416.977960:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790100416.977987:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140971520:0@lo:400:kworker.0 00000100:00080000:3.0:1790100416.978021:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790100416.978025:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100416.988689:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056140972288:12345-0@lo:400:kworker.0 Request processed in 11806us (11996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100416.988705:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:00080000:2.0:1790100416.990074:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ec8a80 x1877056140972288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100416.990091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056140972288:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.990112:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140972800:0@lo:400:kworker.0 00000100:00100000:2.0:1790100416.990167:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100416.990234:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140971776:0@lo:400:kworker.0 00000100:00100000:3.0:1790100416.990495:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140972800 00000100:00100000:3.0:1790100416.990502:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140972800 00000100:00100000:3.0:1790100416.990565:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790100416.990573:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140972800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790100416.990661:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790100416.990717:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140972800:12345-0@lo:400:kworker.0 Request processed in 144us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100416.990736:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00010000:00080000:0.0:1790100416.990810:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ecaa00 x1877056140972800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100416.990820:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140972800:0@lo:400:kworker.0 00010000:00010000:3.0:1790100417.354586:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100418.377572:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100418.906108:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100418.906302:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100418.906411:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127265664 00000100:00100000:2.0:1790100418.906421:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127265664 00000100:00100000:2.0:1790100418.906482:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 358 00000100:00100000:2.0:1790100418.906494:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127265664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100418.906571:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127265664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100418.906579:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 358 00000100:00100000:3.0:1790100418.906882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127265792 00000100:00100000:3.0:1790100418.906887:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127265792 00000100:00100000:3.0:1790100418.906937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1790100418.906946:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127265792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100418.906994:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127265792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 50us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100418.907002:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00080000:2.0:1790100418.907073:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100418.909411:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100418.909553:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127265920 00000100:00100000:1.0:1790100418.909574:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127265920 00000100:00100000:1.0:1790100418.909695:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:1.0:1790100418.909706:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127265920:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100418.909780:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127265920:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 75us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100418.909787:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00080000:2.0:1790100418.914696:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100418.932116:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100418.932173:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100418.932423:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127266048 00000100:00100000:2.0:1790100418.932433:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127266048 00000100:00100000:2.0:1790100418.932530:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1790100418.932540:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2418:x1877056127266048:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1790100418.932570:0:10090:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286d63 00000100:00080000:2.0:1790100418.932580:0:10090:0:(import.c:65:import_set_state_nolock()) ffff926083daf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790100418.932624:0:10090:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1790100418.932769:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+2:2418:x1877056127266048:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 230us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100418.932777:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00010000:00010000:2.0:1790100418.932797:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790100418.933059:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100418.933118:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127266176 00000100:00100000:3.0:1790100418.933122:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127266176 00000100:00100000:3.0:1790100418.933182:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:3.0:1790100418.933199:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127266176:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100418.933254:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127266176:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 64us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100418.933261:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00080000:1.0:1790100418.933571:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100418.936661:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100418.936742:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127266304 00000100:00100000:0.0:1790100418.936752:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127266304 00000100:00100000:0.0:1790100418.936824:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:0.0:1790100418.936834:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127266304:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100418.936920:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127266304:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 87us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100418.936928:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00080000:1.0:1790100418.937088:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1790100419.400540:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100420.041442:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140972928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100420.041512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100420.041586:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100420.041596:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140973056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100420.041625:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100420.041705:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140972928 00000100:00100000:0.0:1790100420.041713:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140972928 00000100:00100000:3.0:1790100420.041754:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140973056 00000100:00100000:3.0:1790100420.041760:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140973056 00000100:00100000:3.0:1790100420.041797:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790100420.041805:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140973056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100420.041834:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100420.041917:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140973056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100420.041925:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1790100420.042134:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100420.042365:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140973056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100420.044733:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790100420.044775:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140972928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100420.044805:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100420.044877:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140972928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (3365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100420.044884:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790100420.045156:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140972928:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790100420.424563:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100420.553098:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140973184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100420.553166:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100420.553271:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140973184 00000100:00100000:2.0:1790100420.553278:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140973184 00000100:00100000:2.0:1790100420.553324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790100420.553333:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140973184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100420.553388:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790100420.553698:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140973184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 365us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100420.553706:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790100420.553816:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140973184:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790100421.451605:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100421.581840:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140973312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100421.581919:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100421.592933:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140973312 00000100:00100000:3.0:1790100421.592946:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140973312 00000100:00100000:3.0:1790100421.593000:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790100421.593011:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140973312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790100421.593046:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790100421.593124:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140973312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (11205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100421.593131:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790100421.593194:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140973312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100422.089707:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140973440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100422.089784:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100422.089839:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140973440 00000100:00100000:2.0:1790100422.089846:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140973440 00000100:00100000:1.0:1790100422.089861:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100422.089868:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140973568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100422.089890:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790100422.089925:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100422.094010:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056140973824:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094074:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.094110:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056140974336:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094176:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.094197:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056140974848:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094228:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.094255:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790100422.094261:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140973696:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094286:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.094304:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140974208:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094325:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.094374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140974720:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094396:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.094436:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140973824 00000100:00100000:3.0:1790100422.094443:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140973824 00000100:00100000:3.0:1790100422.094761:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140974336 00000100:00100000:3.0:1790100422.094766:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140974336 00000100:00100000:3.0:1790100422.094794:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140974848 00000100:00100000:3.0:1790100422.094796:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140974848 00000100:00100000:3.0:1790100422.094813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790100422.094820:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056140973824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094875:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056140973824:12345-0@lo:400:kworker.0 Request processed in 55us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.094883:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790100422.094900:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790100422.094907:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877056140974336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094935:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877056140974336:12345-0@lo:400:kworker.0 Request processed in 28us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.094940:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790100422.094951:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790100422.094957:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056140974848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.094983:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056140974848:12345-0@lo:400:kworker.0 Request processed in 26us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.094989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790100422.095014:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140973696 00000100:00100000:3.0:1790100422.095018:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140973696 00000100:00100000:3.0:1790100422.095042:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1790100422.095049:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140973696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.095077:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140973696:12345-0@lo:400:kworker.0 Request processed in 29us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.095083:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1790100422.095108:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140974208 00000100:00100000:3.0:1790100422.095119:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140974208 00000100:00100000:3.0:1790100422.095145:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790100422.095151:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140974208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.095184:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140974208:12345-0@lo:400:kworker.0 Request processed in 33us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.095191:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790100422.095207:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140974720 00000100:00100000:3.0:1790100422.095211:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140974720 00000100:00100000:3.0:1790100422.095252:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100422.095259:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140974720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.095289:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140974720:12345-0@lo:400:kworker.0 Request processed in 31us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.095295:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100422.095332:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140973696:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.095378:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140974208:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096136:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140974720:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096148:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056140973824:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096157:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056140974336:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056140974848:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096236:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140974080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096273:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.096393:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140974592:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.096579:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790100422.096586:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140973952:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096611:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100422.096631:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140974464:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.096649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100422.096777:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140973568 00000100:00100000:2.0:1790100422.096784:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140973568 00000100:00100000:2.0:1790100422.096825:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790100422.096834:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140973440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100422.096859:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100422.096898:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140973440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (7114us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100422.096904:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790100422.096919:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790100422.096924:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140973568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790100422.096936:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100422.096958:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140973568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (7066us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100422.096962:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790100422.097000:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140974592 00000100:00100000:2.0:1790100422.097003:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140974592 00000100:00100000:2.0:1790100422.097030:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790100422.097035:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140974592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100422.097062:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140974592:12345-0@lo:400:kworker.0 Request processed in 27us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100422.097068:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1790100422.097086:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100422.097090:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100422.097092:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790100422.097126:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083ecaa00 x1877056140973568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100422.097142:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140973568:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1790100422.097154:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c1b43800 x1877056140973440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100422.097164:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140973440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100422.097209:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140973952 00000100:00100000:2.0:1790100422.097225:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140973952 00000100:00100000:2.0:1790100422.097250:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790100422.097257:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140973952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100422.097289:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140973952:12345-0@lo:400:kworker.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100422.097295:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790100422.097986:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056140974976:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.098017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100422.098063:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140974080 00000100:00100000:0.0:1790100422.098069:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140974080 00000100:00100000:2.0:1790100422.098110:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140974464 00000100:00100000:2.0:1790100422.098114:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140974464 00000100:00100000:2.0:1790100422.098143:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790100422.098149:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140974080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100422.098183:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140974080:12345-0@lo:400:kworker.0 Request processed in 34us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100422.098190:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790100422.098203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1790100422.098208:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140974464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100422.098248:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056140974464:12345-0@lo:400:kworker.0 Request processed in 38us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100422.098254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:2.0:1790100422.098283:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790100422.101189:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140974080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.101204:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140974592:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.101246:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140973952:0@lo:400:kworker.0 00010000:00080000:3.0:1790100422.101260:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf6d80 x1877056140974464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100422.101272:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056140974464:0@lo:400:kworker.0 00000100:00100000:3.0:1790100422.101306:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140974976 00000100:00100000:3.0:1790100422.101312:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140974976 00000100:00100000:3.0:1790100422.101390:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1790100422.101398:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056140974976:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790100422.101445:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790100422.101461:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056140974976:12345-0@lo:400:kworker.0 Request processed in 63us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.101469:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:3.0:1790100422.101497:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083d16d80 x1877056140974976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100422.101506:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056140974976:0@lo:400:kworker.0 00010000:00010000:3.0:1790100422.476469:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100422.921013:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790100422.923980:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790100423.501760:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100424.023954:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100424.023994:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100424.024064:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127266432 00000100:00100000:3.0:1790100424.024074:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127266432 00000100:00100000:3.0:1790100424.024123:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 360 00000100:00100000:3.0:1790100424.024132:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127266432:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100424.024197:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127266432:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100424.024213:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 360 00000100:00100000:0.0:1790100424.024761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100424.029334:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100424.033251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127266688 00000100:00100000:1.0:1790100424.033266:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127266688 00000100:00100000:1.0:1790100424.033360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127266944 00000100:00100000:1.0:1790100424.033363:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127266944 00000100:00100000:1.0:1790100424.033398:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:1.0:1790100424.033409:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127266688:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100424.033486:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127266688:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (9491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100424.033493:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:1.0:1790100424.033517:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:1.0:1790100424.033522:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127266944:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100424.033544:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127266944:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (8785us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100424.033550:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00080000:1.0:1790100424.033568:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100424.033734:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127266560 00000100:00100000:0.0:1790100424.033738:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127266560 00000100:00100000:0.0:1790100424.033764:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:0.0:1790100424.033770:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127266560:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100424.033798:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127266560:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (4474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100424.033804:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:0.0:1790100424.033861:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100424.033873:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127266816 00000100:00100000:0.0:1790100424.033876:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127266816 00000100:00100000:0.0:1790100424.033890:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:0.0:1790100424.033901:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127266816:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100424.033922:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127266816:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100424.033927:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00080000:1.0:1790100424.034012:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790100424.521557:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790100424.652012:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:2.0:1790100424.652022:0:8420:0:(genops.c:885:class_export_put()) final put ffff926083dab800/e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:0.0:1790100424.652230:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff926083dab800/e84eb833-b466-4273-a7db-c12bb35adfb4 for lustre-OST0000 00000020:00000080:0.0:1790100424.652279:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083daf800 for lustre-OST0000 00000100:00100000:3.0:1790100425.163028:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140975104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790100425.163098:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100425.163300:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140975104 00000100:00100000:2.0:1790100425.163308:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140975104 00000100:00100000:2.0:1790100425.163387:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790100425.163397:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140975104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790100425.163433:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100425.163484:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140975104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100425.163491:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790100425.164960:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140975232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100425.165016:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100425.166113:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140975232 00000100:00100000:1.0:1790100425.166123:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140975232 00000100:00080000:3.0:1790100425.166135:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100425.166182:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790100425.166183:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140975104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100425.166200:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140975232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100425.166220:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100425.166278:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140975232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100425.166285:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790100425.166823:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140975232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790100425.548229:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100425.672666:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140975360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100425.672731:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100425.672877:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140975360 00000100:00100000:3.0:1790100425.672885:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140975360 00000100:00100000:3.0:1790100425.672934:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790100425.672944:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140975360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100425.672976:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790100425.673029:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140975360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100425.673037:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790100425.673151:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140975360:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1790100426.121867:0:14045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:07:04 (1790100424) 00010000:00010000:2.0:1790100426.569550:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100426.698263:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140975488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100426.698330:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100426.698441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140975488 00000100:00100000:3.0:1790100426.698449:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140975488 00000100:00100000:3.0:1790100426.698511:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790100426.698522:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140975488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100426.704043:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100426.704207:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140975488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5683us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100426.704220:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100426.705863:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140975488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100427.208654:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140975616:0@lo:400:kworker.0 00000100:00100000:2.0:1790100427.208729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100427.208778:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140975616 00000100:00100000:3.0:1790100427.208787:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140975616 00000100:00100000:2.0:1790100427.208932:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100427.209015:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1790100427.209024:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140975616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209056:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140975872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100427.209093:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140976128:0@lo:400:kworker.0 00000100:00100000:2.0:1790100427.209128:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100427.209150:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140976000:0@lo:400:kworker.0 00000100:00100000:2.0:1790100427.209172:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100427.209215:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100427.209238:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140976256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100427.209259:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100427.209282:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140976128 00000100:00100000:0.0:1790100427.209287:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140976128 00000100:00100000:1.0:1790100427.209289:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140976768:0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100427.209327:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1790100427.209334:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140976128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209360:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140977280:0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209379:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100427.209385:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056140976128:12345-0@lo:400:kworker.0 Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.209392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790100427.209395:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790100427.209399:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140975744:0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.209414:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140975872 00000100:00100000:0.0:1790100427.209418:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140975872 00000100:00100000:1.0:1790100427.209419:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100427.209434:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140976384:0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.209445:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140976256 00000100:00100000:0.0:1790100427.209448:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140976256 00000100:00100000:1.0:1790100427.209452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100427.209461:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790100427.209467:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140976896:0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.209467:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140975872:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100427.209483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1790100427.209487:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100427.209512:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790100427.209517:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140975872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100427.209519:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140976256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100427.209524:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00002000:00000024:1.0:1790100427.209530:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100427.209546:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140975744 00000100:00100000:0.0:1790100427.209550:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140975744 00000100:00100000:1.0:1790100427.209552:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140976256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100427.209557:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790100427.209570:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790100427.209573:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140976768 00000100:00100000:0.0:1790100427.209575:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140975744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209576:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140976768 00000100:00100000:1.0:1790100427.209599:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140977280 00000100:00100000:1.0:1790100427.209601:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140977280 00000100:00100000:0.0:1790100427.209604:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140975744:12345-0@lo:400:kworker.0 Request processed in 29us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.209609:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790100427.209611:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140976896 00000100:00100000:1.0:1790100427.209613:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140976896 00000100:00080000:0.0:1790100427.209623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100427.209624:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1790100427.209626:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100427.209629:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140976768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.209647:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140976000 00000100:00100000:0.0:1790100427.209651:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140976000 00000100:00100000:1.0:1790100427.209658:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140976768:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.209671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140976384 00000100:00100000:1.0:1790100427.209672:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790100427.209674:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140976384 00000100:00100000:1.0:1790100427.209684:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790100427.209684:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790100427.209689:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140977280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.209690:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140976000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209716:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140977280:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.209716:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140976000:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100427.209722:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790100427.209723:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790100427.209732:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790100427.209733:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790100427.209738:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140976896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.209738:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140976384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209762:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140976896:12345-0@lo:400:kworker.0 Request processed in 24us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.209762:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140976384:12345-0@lo:400:kworker.0 Request processed in 24us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.209768:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790100427.209769:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790100427.209802:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140975744:0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209821:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140976512:0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100427.209862:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140977024:0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.209880:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100427.209896:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790100427.209902:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140976640:0@lo:400:kworker.0 00000100:00100000:3.0:1790100427.209909:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140975616:12345-0@lo:400:kworker.0 Request processed in 887us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100427.209917:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1790100427.209920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100427.209934:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140977152:0@lo:400:kworker.0 00000100:00100000:3.0:1790100427.209945:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140976512 00000100:00100000:3.0:1790100427.209949:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140976512 00000100:00100000:1.0:1790100427.209951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100427.209968:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140977024 00000100:00100000:3.0:1790100427.209970:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140977024 00000100:00100000:1.0:1790100427.209970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140976640 00000100:00100000:1.0:1790100427.209972:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140976640 00000100:00100000:3.0:1790100427.209982:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140977152 00000100:00100000:3.0:1790100427.209984:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140977152 00000100:00100000:1.0:1790100427.209986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790100427.209991:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140976512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100427.209995:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790100427.210000:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140977024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.210030:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140976512:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100427.210036:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1790100427.210043:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140976384:0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.210047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1790100427.210053:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140976640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.210053:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140976896:0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.210072:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140976768:0@lo:400:kworker.0 00010000:00080000:0.0:1790100427.210087:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd3b80 x1877056140977280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100427.210097:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140977280:0@lo:400:kworker.0 00010000:00080000:0.0:1790100427.210107:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083bf5f80 x1877056140975872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100427.210120:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140975872:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1790100427.210127:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c2300 x1877056140976256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100427.210135:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140976256:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790100427.210284:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100427.210287:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100427.210297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790100427.210304:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140977152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100427.210386:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140975616:0@lo:400:kworker.0 00000100:00100000:2.0:1790100427.210404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056140976128:0@lo:400:kworker.0 00000100:00100000:2.0:1790100427.210412:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140976000:0@lo:400:kworker.0 00000100:00100000:3.0:1790100427.211281:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140977024:12345-0@lo:400:kworker.0 Request processed in 1276us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100427.211290:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:2.0:1790100427.214272:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6254e00 x1877056140976640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100427.214272:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140976640:12345-0@lo:400:kworker.0 Request processed in 4210us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100427.214285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790100427.214287:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140976640:0@lo:400:kworker.0 00000100:00100000:0.0:1790100427.214971:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140977152:12345-0@lo:400:kworker.0 Request processed in 4665us (5015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.214980:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00080000:2.0:1790100427.216699:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083cd2680 x1877056140977152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100427.216715:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140977152:0@lo:400:kworker.0 00000100:00100000:2.0:1790100427.216732:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140976512:0@lo:400:kworker.0 00000100:00100000:2.0:1790100427.216743:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140977024:0@lo:400:kworker.0 00000100:00100000:1.0:1790100427.370384:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100427.370474:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127267072 00000100:00100000:2.0:1790100427.370484:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127267072 00000100:00100000:2.0:1790100427.370547:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1790100427.370556:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:11070:x1877056127267072:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100427.370575:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100427.370598:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286e43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e11a expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.370694:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298286e4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.370707:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298286e4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.370719:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298286e4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100427.370765:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790100427.370769:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100427.370806:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298286e4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.370830:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286e43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e11a expref: 7 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.370846:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298286e4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e11a expref: 6 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.370855:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b900) 00010000:00010000:2.0:1790100427.370858:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100427.370861:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927000, rc 0) 00000100:00100000:2.0:1790100427.370922:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:11070:x1877056127267072:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 367us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100427.370929:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00080000:0.0:1790100427.370999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100427.380489:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100427.382163:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127267200 00000100:00100000:0.0:1790100427.382186:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127267200 00000100:00100000:0.0:1790100427.382259:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1790100427.382269:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+6:11071:x1877056127267200:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100427.382288:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100427.382326:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e121 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382414:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382429:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382443:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382456:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382462:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382469:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382528:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298286e66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382535:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298286e66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382542:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298286e66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100427.382578:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790100427.382582:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100427.382601:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298286e66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382619:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382625:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382631:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382636:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100427.382640:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382646:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382657:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b900) 00010000:00010000:0.0:1790100427.382659:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.382664:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382669:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382694:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382700:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382704:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382712:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100427.382714:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382718:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382724:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff926083e1b700) 00010000:00010000:0.0:1790100427.382725:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.382727:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382731:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382752:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e121 expref: 8 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382760:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298286e66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e121 expref: 7 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.382765:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff926083e1b100) 00010000:00010000:0.0:1790100427.382767:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100427.382768:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46200, rc 0) 00000100:00100000:0.0:1790100427.382830:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+7:11071:x1877056127267200:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 562us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.382837:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1790100427.391299:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100427.391384:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127267328 00000100:00100000:3.0:1790100427.391395:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127267328 00000100:00100000:3.0:1790100427.391452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1790100427.391463:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:11071:x1877056127267328:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790100427.391545:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:11071:x1877056127267328:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100427.391552:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790100427.395988:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100427.396066:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127267584 00000100:00100000:0.0:1790100427.396086:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127267584 00000100:00100000:0.0:1790100427.396147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1790100427.396157:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:11071:x1877056127267584:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100427.396188:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100427.396208:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e128 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396334:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396375:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396387:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396441:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396449:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396456:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396560:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286e82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396569:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286e82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396577:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286e82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100427.396595:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790100427.396677:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396686:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396693:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396700:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100427.396704:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396711:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396722:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff926083e1b100) 00010000:00010000:0.0:1790100427.396725:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.396730:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396736:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396748:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396751:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396763:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396766:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100427.396768:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396772:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396776:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff926083e1b700) 00010000:00010000:0.0:1790100427.396778:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.396779:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.396783:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298286e7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.397679:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298286e6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e128 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.397699:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286e82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e128 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.397707:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:0.0:1790100427.397709:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.397712:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47800, rc 0) 00000100:00100000:0.0:1790100427.397781:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:11071:x1877056127267584:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1625us (1802us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790100427.397804:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1790100427.402977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100427.410790:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127267712 00000100:00100000:3.0:1790100427.410805:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127267712 00000100:00100000:2.0:1790100427.411230:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1790100427.411241:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+9:11071:x1877056127267712:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790100427.411392:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+9:11071:x1877056127267712:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 152us (8424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100427.411400:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1790100427.416518:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100427.425027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127267840 00000100:00100000:1.0:1790100427.425042:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127267840 00000100:00080000:0.0:1790100427.425163:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100427.425218:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1790100427.425226:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:11071:x1877056127267840:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1790100427.426270:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1006us 00000100:00100000:2.0:1790100427.435395:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:11071:x1877056127267840:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 10159us (18876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100427.435409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00010000:00010000:2.0:1790100427.593606:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100428.041007:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790100428.041336:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790100428.617157:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100428.865030:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100428.865113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127267968 00000100:00100000:0.0:1790100428.865123:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127267968 00000100:00100000:0.0:1790100428.865215:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1790100428.865226:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:11113:x1877056127267968:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100428.865243:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.865261:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e12f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865332:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865367:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865380:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865394:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865402:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865408:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865455:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865462:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865468:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865474:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100428.865478:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865486:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865497:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b900) 00010000:00010000:0.0:1790100428.865500:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100428.865505:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865510:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298286e97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865519:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865525:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865531:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865542:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100428.865545:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865551:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865559:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff926083e1b700) 00010000:00010000:0.0:1790100428.865561:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100428.865564:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865570:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298286e9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865600:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e12f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865609:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b900) 00010000:00010000:0.0:1790100428.865612:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100428.865615:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298286e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e12f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.865635:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46000, rc 0) 00000100:00100000:0.0:1790100428.865693:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:11113:x1877056127267968:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 469us (672us total) trans 0 rc 301/301 00000100:00100000:0.0:1790100428.865700:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1790100428.872210:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100428.872331:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127268224 00000100:00100000:1.0:1790100428.872356:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127268224 00000100:00100000:1.0:1790100428.872407:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1790100428.872418:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+9:11113:x1877056127268224:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:1.0:1790100428.872470:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100428.872494:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298286e4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e11a expref: 9 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.872510:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b900) 00010000:00010000:1.0:1790100428.872526:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100428.872581:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.872593:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.872601:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.872612:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.872631:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.872637:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873076:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873086:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873092:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100428.873233:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a7a5c03 reply state 00000000e50e8ffd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873246:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873263:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100428.873266:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100428.873268:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790100428.873272:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790100428.873279:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873285:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873291:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873297:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100428.873301:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873309:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873316:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926083b64d00) 00010000:00010000:1.0:1790100428.873319:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.873322:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873328:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286ea5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100428.873361:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a7a5c03 reply state 00000000e50e8ffd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873383:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.873389:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff926083b64700) 00010000:00010000:1.0:1790100428.873392:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100428.873394:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790100428.873485:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+10:11113:x1877056127268224:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 1066us (1280us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790100428.873493:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1790100428.948067:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100428.948478:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127268352 00000100:00100000:3.0:1790100428.948488:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127268352 00000100:00100000:3.0:1790100428.948556:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:3.0:1790100428.948567:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+10:11121:x1877056127268352:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:3.0:1790100428.948593:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100428.948616:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e136 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.948678:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286ec1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.948690:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.948701:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100428.948745:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790100428.948749:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100428.948785:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.948809:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e136 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.948826:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e136 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.948835:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:3.0:1790100428.948837:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100428.948841:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565d400, rc 0) 00000100:00100000:3.0:1790100428.948898:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+11:11121:x1877056127268352:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 332us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.948910:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1790100429.017990:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100429.019261:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127268480 00000100:00100000:2.0:1790100429.019274:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127268480 00000100:00100000:2.0:1790100429.019380:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1790100429.019392:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:11127:x1877056127268480:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100429.019412:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100429.019432:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286ec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e13d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019497:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019511:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019522:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019533:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019554:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019561:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019634:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927a00/0xc87a4f2298286edd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019642:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927a00/0xc87a4f2298286edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019649:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927a00/0xc87a4f2298286edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100429.019684:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790100429.019701:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100429.019741:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927a00/0xc87a4f2298286edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019753:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019760:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019766:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019772:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100429.019776:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019789:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019802:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:2.0:1790100429.019805:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100429.019809:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019816:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286ecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019830:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019836:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019842:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019847:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100429.019849:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019855:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019861:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff926083b64700) 00010000:00010000:2.0:1790100429.019864:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100429.019867:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019881:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298286ed6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019907:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298286ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e13d expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019922:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927a00/0xc87a4f2298286edd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e13d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.019929:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100429.019931:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790100429.019934:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927a00, rc 0) 00000100:00100000:2.0:1790100429.020001:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+12:11127:x1877056127268480:12345-192.168.203.13@tcp:101:bash.0 Request processed in 611us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100429.020009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00080000:0.0:1790100429.020959:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100429.026753:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.026854:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127268736 00000100:00100000:1.0:1790100429.026864:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127268736 00000100:00100000:1.0:1790100429.026921:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1790100429.026931:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+12:11127:x1877056127268736:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790100429.026958:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100429.026977:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286ee4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e144 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027073:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027087:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027097:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027175:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027197:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027205:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790100429.027609:0:12139:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790100429.027735:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027744:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027750:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027780:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027786:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027792:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027798:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100429.027801:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027808:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027830:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100429.027832:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100429.027837:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027843:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286eeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100429.027854:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008976c293 reply state 0000000070c53acb transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027863:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027869:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:1.0:1790100429.027872:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100429.027874:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790100429.027902:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286ee4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 15 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027917:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 14 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.027924:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64d00) 00010000:00010000:1.0:1790100429.027926:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100429.027929:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:1.0:1790100429.027992:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+15:11127:x1877056127268736:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1062us (1247us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790100429.028000:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1790100429.035738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.035808:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127268864 00000100:00100000:3.0:1790100429.035818:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127268864 00000100:00100000:3.0:1790100429.035868:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1790100429.035875:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b7be1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2418:x1877056127268864:12345-192.168.203.13@tcp:8:bash.0 00010000:00080000:3.0:1790100429.035910:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:3.0:1790100429.035941:0:8427:0:(genops.c:1384:class_connect()) connect: client e84eb833-b466-4273-a7db-c12bb35adfb4, cookie 0xc87a4f2298286f07 00002000:00100000:3.0:1790100429.035953:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e84eb833-b466-4273-a7db-c12bb35adfb4/ffff926185556800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790100429.035970:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790100429.036065:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790100429.036094:0:8427:0:(import.c:65:import_set_state_nolock()) ffff926185557800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100429.036180:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b7be1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2418:x1877056127268864:12345-192.168.203.13@tcp:8:bash.0 Request processed in 303us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.036188:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:0.0:1790100429.038847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100429.038982:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127268992 00000100:00100000:2.0:1790100429.038991:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127268992 00000100:00100000:2.0:1790100429.039060:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1790100429.039068:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:0:x1877056127268992:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100429.039084:0:10090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1790100429.039149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790100429.039217:0:10090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e14b expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100429.039243:0:10090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100429.039261:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1790100429.039265:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100429.039285:0:10090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 7 pid: 10090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.039305:0:10090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 7 pid: 10090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.039316:0:10090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926e00, rc 0) 00000100:00100000:2.0:1790100429.039398:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:0:x1877056127268992:12345-192.168.203.13@tcp:101:bash.0 Request processed in 330us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100429.039405:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1790100429.041516:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.041578:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127269120 00000100:00100000:3.0:1790100429.041586:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127269120 00000100:00100000:3.0:1790100429.041627:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1790100429.041633:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:11127:x1877056127269120:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100429.041646:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100429.041659:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e152 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.041680:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 8 pid: 10090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.041700:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100429.041703:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100429.041706:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.041743:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 8 pid: 10090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.041752:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 8 pid: 10090 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.041762:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1877056140977408:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100429.041835:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be600 going to sleep for 11 seconds 00000100:00100000:1.0:1790100429.043536:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100429.043600:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127269248 00000100:00100000:2.0:1790100429.043608:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127269248 00010000:00010000:2.0:1790100429.043642:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 9 pid: 10090 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100429.043678:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1790100429.043686:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184255c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2422:x1877056127269248:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100429.043697:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100429.043728:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 9 pid: 10090 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.043740:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 9 pid: 10090 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.043761:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100429.043773:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100429.043780:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.043787:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.043811:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100429.043819:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ec8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6499:1877056140977536:192.168.203.13@tcp:105: 00000100:00100000:2.0:1790100429.043873:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790100429.044117:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef0749d/0xc87a4f2298286f0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e14b expref: 9 pid: 10090 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.044129:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1877056140977408:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100429.044145:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.044151:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565d600, rc 0) 00000100:00100000:3.0:1790100429.044331:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:11127:x1877056127269120:12345-192.168.203.13@tcp:101:bash.0 Request processed in 2696us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.044834:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1790100429.046209:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ec8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6499:1877056140977536:192.168.203.13@tcp:105: 00010000:00010000:2.0:1790100429.046235:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100429.046285:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184255c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127269248:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2599us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100429.046295:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1790100429.047488:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.047548:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127269504 00000100:00100000:1.0:1790100429.047555:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127269504 00000100:00100000:1.0:1790100429.047595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1790100429.047602:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+15:11127:x1877056127269504:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1790100429.047832:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+16:11127:x1877056127269504:12345-192.168.203.13@tcp:35:bash.0 Request processed in 228us (346us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790100429.047839:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1790100429.112120:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.112291:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127269760 00000100:00100000:3.0:1790100429.112300:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127269760 00000100:00100000:3.0:1790100429.112398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1790100429.112408:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+16:11137:x1877056127269760:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100429.112431:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100429.112450:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e159 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100429.112544:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790100429.112637:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e159 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.112659:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:3.0:1790100429.112662:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100429.112668:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e159 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.112683:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565dc00, rc 0) 00000100:00100000:3.0:1790100429.112741:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+17:11137:x1877056127269760:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 334us (637us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1790100429.112748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1790100429.115725:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.116182:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127270016 00000100:00100000:1.0:1790100429.116192:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127270016 00000100:00100000:1.0:1790100429.118496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790100429.118518:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+17:11137:x1877056127270016:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100429.119046:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+18:11137:x1877056127270016:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 537us (3328us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1790100429.119055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1790100429.165293:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100429.165331:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100429.165398:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100429.165489:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127270272 00000100:00100000:2.0:1790100429.165499:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127270272 00000100:00100000:2.0:1790100429.165561:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127270528 00000100:00100000:2.0:1790100429.165565:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127270528 00000100:00100000:2.0:1790100429.165585:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:2.0:1790100429.165593:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127270272:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100429.165658:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127270272:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 65us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100429.165667:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00080000:0.0:1790100429.165884:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100429.167043:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:1.0:1790100429.167059:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127270528:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100429.167124:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127270528:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.167133:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:3.0:1790100429.167389:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127270144 00000100:00100000:3.0:1790100429.167395:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127270144 00000100:00100000:3.0:1790100429.167434:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 362 00000100:00100000:3.0:1790100429.167442:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127270144:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100429.167486:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127270144:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 45us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.167493:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 362 00000100:00100000:0.0:1790100429.168418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.169325:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127270400 00000100:00100000:3.0:1790100429.169333:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127270400 00000100:00100000:3.0:1790100429.169411:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:3.0:1790100429.169419:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127270400:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100429.169472:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127270400:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 54us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.169479:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00080000:0.0:1790100429.169547:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100429.175309:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.175626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127270656 00000100:00100000:1.0:1790100429.175636:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127270656 00000100:00100000:1.0:1790100429.175689:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1790100429.175698:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+18:11143:x1877056127270656:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100429.175834:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100429.175854:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e160 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.175922:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286f31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.175936:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.175946:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100429.175986:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1790100429.175990:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100429.176007:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.176031:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e160 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.176048:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286f31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e160 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.176056:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100429.176058:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100429.176062:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7200, rc 0) 00000100:00100000:1.0:1790100429.176186:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+19:11143:x1877056127270656:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 488us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.176193:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1790100429.179642:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.179717:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127270912 00000100:00100000:3.0:1790100429.179726:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127270912 00000100:00100000:3.0:1790100429.179777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1790100429.179787:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+19:11143:x1877056127270912:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100429.179804:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100429.179821:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e167 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.179937:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.179950:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.179959:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100429.179969:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790100429.180077:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e167 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.180095:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e167 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.180243:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64d00) 00010000:00010000:3.0:1790100429.180246:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100429.180250:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565dc00, rc 0) 00000100:00100000:3.0:1790100429.180304:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+21:11143:x1877056127270912:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 518us (669us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1790100429.180319:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1790100429.184071:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100429.184206:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127271168 00000100:00100000:2.0:1790100429.184215:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127271168 00000100:00100000:2.0:1790100429.184272:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1790100429.184282:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+21:11143:x1877056127271168:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100429.184304:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100429.184322:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286f4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e16e expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.184444:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286f54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.184458:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286f54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.184471:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286f54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100429.184481:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790100429.184578:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298286f4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e16e expref: 24 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.184595:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286f54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e16e expref: 23 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.184603:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64d00) 00010000:00010000:2.0:1790100429.184606:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790100429.184609:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926800, rc 0) 00000100:00100000:2.0:1790100429.184652:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+23:11143:x1877056127271168:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 372us (590us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790100429.184671:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1790100429.187990:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.188237:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127271296 00000100:00100000:1.0:1790100429.188247:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127271296 00000100:00100000:1.0:1790100429.188307:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1790100429.188317:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+23:2421:x1877056127271296:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100429.188333:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100429.188391:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e167 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.188409:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64d00) 00010000:00010000:1.0:1790100429.188414:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100429.188454:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+22:2421:x1877056127271296:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 139us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.188461:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1790100429.192362:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.192461:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127271424 00000100:00100000:3.0:1790100429.192470:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127271424 00000100:00100000:3.0:1790100429.192523:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1790100429.192532:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127271424:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:3.0:1790100429.192570:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.192588:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.192595:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100429.192599:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100429.192603:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.192633:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.192658:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 7 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.192672:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8425:1877056140977664:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100429.192758:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100429.195884:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.195988:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127271552 00000100:00100000:1.0:1790100429.195997:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127271552 00002000:00100000:1.0:1790100429.196034:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9261a6256300 x1877056127271552/t0(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:725/0 lens 504/0 e 0 to 0 dl 1790100440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100429.196045:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9261a6256300 with x1877056127271552 ext(0->12) 00010000:00010000:1.0:1790100429.196053:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 8 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.196068:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 8 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100429.196076:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9261a6256300 00000100:00100000:1.0:1790100429.196112:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1790100429.196121:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127271552:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:3.0:1790100429.197781:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8425:1877056140977664:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100429.197810:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1790100429.198030:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000100:00100000:1.0:1790100429.198610:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2422:x1877056127271552:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 2486us (2731us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790100429.198619:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:1.0:1790100429.198630:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9261a6256300 x1877056127271552/t4294967300(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:725/0 lens 504/448 e 0 to 0 dl 1790100440 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100429.198640:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9261a6256300 with x1877056127271552 ext(0->12) 00010000:00010000:1.0:1790100429.198649:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.198663:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100429.198672:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9261a6256300 00000100:00100000:0.0:1790100429.207330:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.207453:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127271680 00000100:00100000:3.0:1790100429.207463:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127271680 00010000:00010000:3.0:1790100429.207512:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.207555:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1790100429.207565:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2420:x1877056127271680:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100429.207577:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790100429.207594:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790100429.207597:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1790100428 00002000:00010000:3.0:1790100429.207599:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1790100428 00002000:00010000:3.0:1790100429.207601:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1790100428 00002000:00010000:3.0:1790100429.207603:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1790100429.207610:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.207642:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.207666:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb3e915/0xc87a4f2298286f15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e152 expref: 9 pid: 8427 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.207682:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100429.207687:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100429.207692:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.207702:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.207737:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100429.207782:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2420:x1877056127271680:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 219us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.207790:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00010000:00010000:0.0:1790100429.208461:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.208473:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.208494:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.208515:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.208525:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.208532:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100429.208537:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.208546:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.208560:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.208568:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025784de1/0xc87a4f2298286f62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100429.208618:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127271424:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 16086us (16288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100429.208626:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1790100429.217056:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.217132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127271936 00000100:00100000:1.0:1790100429.217142:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127271936 00000100:00100000:1.0:1790100429.217256:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790100429.217267:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+22:11143:x1877056127271936:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:1.0:1790100429.217326:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286f54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e16e expref: 22 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100429.217566:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1790100429.217612:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1790100429.217884:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1790100429.217914:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.217928:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 26 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.217944:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.217981:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 26 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.217994:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 26 pid: 12139 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100429.218008:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877056140977792:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100429.218086:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6141240 going to sleep for 11 seconds 00000100:00100000:2.0:1790100429.219498:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877056140977792:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100429.219521:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100429.220113:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.220184:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127272064 00000100:00100000:1.0:1790100429.220190:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127272064 00010000:00010000:1.0:1790100429.220223:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 27 pid: 12139 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100429.220258:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1790100429.220267:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+27:2421:x1877056127272064:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100429.220279:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100429.220285:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 27 pid: 12139 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.220296:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 27 pid: 12139 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.220316:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286ef9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e144 expref: 27 pid: 12139 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.220358:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64d00) 00010000:00010000:1.0:1790100429.220363:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.220371:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.220377:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.220402:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100429.220441:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+26:2421:x1877056127272064:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 176us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.220449:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00010000:00010000:3.0:1790100429.220723:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.220731:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100429.220819:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1790100429.220905:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1790100429.220977:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140977920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790100429.221023:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100429.221078:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100429.221317:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140977920 00000100:00100000:0.0:1790100429.221322:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140977920 00000100:00080000:2.0:1790100429.221445:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100429.221458:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790100429.221473:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140977920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790100429.221570:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140977920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100429.221577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790100429.221584:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140977920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790100429.221697:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1790100429.221735:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140978048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790100429.221761:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100429.221781:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100429.221822:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140978048 00000100:00100000:2.0:1790100429.221826:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140978048 00000100:00100000:2.0:1790100429.221854:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790100429.221861:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140978048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790100429.221951:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1877056140978048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (189us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790100429.221957:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790100429.222075:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140978048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790100429.222157:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1790100429.222193:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.222202:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.222209:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.222215:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100429.222219:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.222227:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.222239:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64d00) 00010000:00010000:3.0:1790100429.222242:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790100429.222245:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.222263:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f69 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100429.222379:0:6516:0:(mdd_object.c:4178:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790100429.223090:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790100429.223175:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 280510834807ns, next at 281510832075ns, rc = 0 00000001:00080000:2.0:1790100429.223184:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1790100429.223215:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64d00) 00010000:00010000:2.0:1790100429.223218:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790100429.223226:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286f54 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e16e expref: 30 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100429.223439:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+29:11143:x1877056127271936:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 6173us (6389us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1790100429.223458:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000020:00080000:2.0:1790100429.223462:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790100429.230372:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.230487:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127272192 00000100:00100000:1.0:1790100429.230496:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127272192 00000100:00100000:1.0:1790100429.230553:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1790100429.230563:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+29:11143:x1877056127272192:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100429.230583:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100429.230603:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298286f70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e175 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.230653:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298286f70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e175 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.230667:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298286f70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e175 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.230714:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100429.230717:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100429.230721:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e200, rc 0) 00000100:00100000:1.0:1790100429.230777:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+30:11143:x1877056127272192:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 215us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.230784:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1790100429.235621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100429.235810:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127272448 00000100:00100000:0.0:1790100429.235820:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127272448 00000100:00100000:0.0:1790100429.235880:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790100429.235889:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+30:11143:x1877056127272448:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1790100429.236110:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+31:11143:x1877056127272448:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 221us (497us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1790100429.236118:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790100429.306896:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.307267:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127272704 00000100:00100000:1.0:1790100429.307277:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127272704 00000100:00100000:1.0:1790100429.307365:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1790100429.307376:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+31:11153:x1877056127272704:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100429.307399:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100429.307420:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f2298286f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e17c expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100429.307508:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790100429.307593:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f2298286f77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e17c expref: 33 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.307607:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:1.0:1790100429.307610:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100429.307615:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f2298286f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e17c expref: 33 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.307628:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f800, rc 0) 00000100:00100000:1.0:1790100429.307684:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+32:11153:x1877056127272704:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 310us (798us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1790100429.307702:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1790100429.311399:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.311525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127272832 00000100:00100000:3.0:1790100429.311536:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127272832 00000100:00100000:3.0:1790100429.311591:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1790100429.311601:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+32:11153:x1877056127272832:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1790100429.311670:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311686:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311698:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311721:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311728:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311734:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311807:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311815:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311836:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100429.311881:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311892:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.311898:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312436:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312443:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100429.312447:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312455:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312467:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:3.0:1790100429.312470:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100429.312474:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312480:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298286f85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312494:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312507:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312513:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312518:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100429.312521:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312527:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312535:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:3.0:1790100429.312538:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100429.312541:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312547:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286f8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312557:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312562:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312567:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312573:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565dc00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100429.312581:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312588:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312595:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100429.312597:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100429.312600:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.312606:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286f93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.312671:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+32:11153:x1877056127272832:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1070us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.312679:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1790100429.315200:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.315272:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127273088 00000100:00100000:1.0:1790100429.315280:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127273088 00000100:00100000:1.0:1790100429.315333:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1790100429.315364:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+32:11153:x1877056127273088:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100429.315541:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+33:11153:x1877056127273088:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 177us (350us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1790100429.315546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790100429.347271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.347364:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127273344 00000100:00100000:3.0:1790100429.347374:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127273344 00000100:00100000:3.0:1790100429.347433:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1790100429.347445:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+33:11156:x1877056127273344:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100429.347468:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100429.347486:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e183 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347557:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347571:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347602:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347614:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347621:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347641:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347809:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347819:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.347826:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100429.347835:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790100429.348180:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348188:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348195:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348201:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100429.348211:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348218:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348229:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:3.0:1790100429.348233:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100429.348236:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348243:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298286fa1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348256:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348261:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348266:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348270:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100429.348272:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348278:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348285:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:3.0:1790100429.348287:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100429.348295:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348301:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298286fa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348435:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298286f9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348451:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.348458:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100429.348461:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100429.348463:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565dc00, rc 0) 00000100:00100000:3.0:1790100429.348515:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+35:11156:x1877056127273344:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1074us (1253us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1790100429.348524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1790100429.356440:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100429.356536:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127273472 00000100:00100000:2.0:1790100429.356546:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127273472 00000100:00100000:2.0:1790100429.356604:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1790100429.356614:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+35:11156:x1877056127273472:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790100429.356674:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356699:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356711:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356744:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356752:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356759:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356764:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100429.356768:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356775:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356799:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:2.0:1790100429.356802:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100429.356806:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.356812:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100429.356873:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+35:11156:x1877056127273472:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 261us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100429.356880:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1790100429.359485:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.359570:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127273728 00000100:00100000:1.0:1790100429.359579:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127273728 00000100:00100000:1.0:1790100429.359631:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1790100429.359639:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+35:11156:x1877056127273728:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100429.359956:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+36:11156:x1877056127273728:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 316us (479us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1790100429.359963:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1790100429.528849:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.528944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127273984 00000100:00100000:1.0:1790100429.528953:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127273984 00000100:00100000:1.0:1790100429.529018:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1790100429.529037:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+36:11187:x1877056127273984:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1790100429.529060:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100429.529078:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f2298286fc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e18a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.529185:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298286fcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.529211:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298286fcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.529221:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298286fcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100429.529233:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790100429.529380:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f2298286fc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e18a expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.529399:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298286fcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e18a expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.529407:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100429.529410:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100429.529413:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8ec00, rc 0) 00000100:00100000:1.0:1790100429.529470:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+38:11187:x1877056127273984:12345-192.168.203.13@tcp:101:cat.0 Request processed in 443us (629us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1790100429.529477:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790100429.533265:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.533398:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100429.533553:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127274368 00000100:00100000:0.0:1790100429.533564:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127274368 00000100:00100000:0.0:1790100429.533629:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1790100429.533639:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+38:2419:x1877056127274368:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100429.533654:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100429.533676:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298286fcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e18a expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.533695:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:0.0:1790100429.533700:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100429.533769:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+37:2419:x1877056127274368:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 131us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100429.533777:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1790100429.534899:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127274240 00000100:00100000:2.0:1790100429.534915:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127274240 00000100:00100000:2.0:1790100429.534954:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1790100429.534963:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+37:11187:x1877056127274240:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1790100429.535331:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+38:11187:x1877056127274240:12345-192.168.203.13@tcp:35:cat.0 Request processed in 368us (2074us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1790100429.535357:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1790100429.594701:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100429.594810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127274624 00000100:00100000:2.0:1790100429.594820:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127274624 00000100:00100000:2.0:1790100429.594880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1790100429.594889:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+38:11193:x1877056127274624:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1790100429.594920:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100429.594923:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790100429.594947:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298286f31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e160 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.594983:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100429.594988:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100429.595006:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fd9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e191 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.595113:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.595127:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.595135:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.595179:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.595192:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 38 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100429.595204:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083ecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140978176:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100429.595301:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100429.598882:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083ecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140978176:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100429.598919:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.602291:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.603053:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127274752 00000100:00100000:1.0:1790100429.603063:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127274752 00010000:00010000:1.0:1790100429.603100:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 39 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100429.603181:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1790100429.603191:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+39:2422:x1877056127274752:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100429.603206:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100429.603229:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 39 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.603242:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 39 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.603263:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f2298286faf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e183 expref: 39 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.603278:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100429.603282:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.603290:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.603297:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.603328:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100429.603419:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+38:2422:x1877056127274752:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 229us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.603426:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00010000:00010000:3.0:1790100429.604089:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.604099:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100429.604116:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790100429.604276:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298286fd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.604294:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.604303:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100429.604305:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100429.604309:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926a00, rc 0) 00000100:00100000:3.0:1790100429.604381:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+38:11193:x1877056127274624:12345-192.168.203.13@tcp:101:dd.0 Request processed in 9494us (9690us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1790100429.604389:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1790100429.608234:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.608460:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127274880 00000100:00100000:1.0:1790100429.608478:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127274880 00000100:00100000:1.0:1790100429.608534:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1790100429.608544:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+38:11193:x1877056127274880:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:1.0:1790100429.608566:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100429.608585:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298286fee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e198 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.608630:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.608643:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.608653:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.609175:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298286fee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.609194:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.609201:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100429.609204:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100429.609208:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8fc00, rc 0) 00000100:00100000:1.0:1790100429.609264:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+39:11193:x1877056127274880:12345-192.168.203.13@tcp:101:dd.0 Request processed in 721us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.609271:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1790100429.613731:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.614075:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127275136 00000100:00100000:3.0:1790100429.614086:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127275136 00000100:00100000:3.0:1790100429.614157:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1790100429.614179:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+39:11193:x1877056127275136:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:3.0:1790100429.614429:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.614446:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.614457:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100429.614497:0:12139:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1790100429.614521:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8260258 reply state 00000000df4a3828 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.614551:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.614559:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100429.614561:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790100429.614565:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100429.614644:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+42:11193:x1877056127275136:12345-192.168.203.13@tcp:36:dd.0 Request processed in 466us (920us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1790100429.614652:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000020:00080000:3.0:1790100429.614656:0:12139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100429.640548:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100429.835620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.835699:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127275264 00000100:00100000:3.0:1790100429.835709:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127275264 00000100:00100000:3.0:1790100429.835765:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:3.0:1790100429.835775:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+42:11207:x1877056127275264:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:3.0:1790100429.835798:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100429.835817:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298287003 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e19f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.835898:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.835912:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.835925:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.835936:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.835955:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.835963:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.836026:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.836038:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.836046:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.836077:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.836091:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 43 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.836112:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140978304:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100429.836302:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100429.840541:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100429.840604:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127275520 00000100:00100000:0.0:1790100429.840614:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127275520 00000100:00100000:3.0:1790100429.840651:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140978304:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100429.840678:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00010000:00010000:3.0:1790100429.840679:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100429.840699:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+44:6182:x1877056127275520:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790100429.840969:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+45:6182:x1877056127275520:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 280us (435us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1790100429.840976:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1790100429.843238:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100429.843328:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127275648 00000100:00100000:3.0:1790100429.843380:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127275648 00010000:00010000:3.0:1790100429.843416:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 45 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.843460:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1790100429.843470:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+45:2421:x1877056127275648:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100429.843482:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100429.843489:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 45 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.843501:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 45 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.843518:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298286fe0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e191 expref: 45 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.843531:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100429.843536:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.843545:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.843552:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.843584:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100429.843636:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+44:2421:x1877056127275648:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 168us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.843654:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00010000:00010000:0.0:1790100429.844986:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.844998:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100429.845047:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790100429.845051:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100429.845092:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845323:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845334:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845452:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845459:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845464:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565dc00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100429.845467:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845475:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845488:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:0.0:1790100429.845492:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100429.845496:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845502:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565dc00/0xc87a4f229828700a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845515:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845521:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845526:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845530:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100429.845540:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845546:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845554:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:0.0:1790100429.845557:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100429.845559:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845565:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287011 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845601:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d600/0xc87a4f2298287003 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e19f expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845617:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e19f expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.845624:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:0.0:1790100429.845627:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100429.845629:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6400, rc 0) 00000100:00100000:0.0:1790100429.845735:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+43:11207:x1877056127275264:12345-192.168.203.13@tcp:101:stat.0 Request processed in 9961us (10124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100429.845743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:0.0:1790100429.917438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100429.917535:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127275904 00000100:00100000:1.0:1790100429.917544:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127275904 00000100:00100000:1.0:1790100429.917605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1790100429.917616:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+43:11213:x1877056127275904:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:1.0:1790100429.917690:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100429.917733:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287018 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e19f expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.917752:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100429.917757:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100429.917923:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.917936:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.917946:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100429.917985:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1790100429.918004:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000245b4747 reply state 000000001eea6c9b transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.918016:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.918023:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100429.918025:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100429.918039:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790100429.918305:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+45:11213:x1877056127275904:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 690us (875us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1790100429.918313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000020:00080000:1.0:1790100429.918317:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790100430.011684:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100430.011751:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127276032 00000100:00100000:2.0:1790100430.011760:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127276032 00000100:00100000:2.0:1790100430.011814:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1790100430.011825:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+45:11227:x1877056127276032:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:2.0:1790100430.011849:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100430.011867:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287026 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1a6 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.011935:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.011948:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.011960:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.011970:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.011977:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.011984:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012048:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012057:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012081:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100430.012119:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1790100430.012123:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100430.012143:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012155:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012179:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012186:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012192:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012198:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100430.012202:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012208:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012219:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100430.012287:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100430.012293:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012310:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f229828702d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012324:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012330:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012336:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012650:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100430.012654:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012661:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012670:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:2.0:1790100430.012673:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100430.012676:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012683:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012713:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287026 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 47 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012727:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 46 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.012741:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:2.0:1790100430.012744:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100430.012746:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927800, rc 0) 00000100:00100000:2.0:1790100430.012805:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+46:11227:x1877056127276032:12345-192.168.203.13@tcp:101:stat.0 Request processed in 982us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100430.012813:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1790100430.064604:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100430.064690:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127276288 00000100:00100000:0.0:1790100430.064700:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127276288 00000100:00100000:0.0:1790100430.064768:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1790100430.064791:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+46:11237:x1877056127276288:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100430.064811:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100430.064830:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1ad expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100430.064938:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1790100430.065031:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287042 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1ad expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.065044:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:0.0:1790100430.065047:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100430.065052:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1ad expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.065066:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47a00, rc 0) 00000100:00100000:0.0:1790100430.065282:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+47:11237:x1877056127276288:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 492us (685us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1790100430.065290:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1790100430.068461:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100430.068610:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127276544 00000100:00100000:1.0:1790100430.068619:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127276544 00000100:00100000:1.0:1790100430.068732:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1790100430.068742:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+47:11237:x1877056127276544:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100430.068993:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+48:11237:x1877056127276544:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 253us (541us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1790100430.068998:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1790100430.103216:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100430.103400:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127276800 00000100:00100000:3.0:1790100430.103410:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127276800 00000100:00100000:3.0:1790100430.105467:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1790100430.105488:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+48:11243:x1877056127276800:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100430.105513:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100430.105538:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298287050 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1b4 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.105646:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.105660:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 49 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.105668:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.105711:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 49 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.105725:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 49 pid: 9338 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100430.105738:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140978432:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100430.106051:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100430.108713:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140978432:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100430.108744:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100430.109020:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100430.110025:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127276928 00000100:00100000:2.0:1790100430.110034:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127276928 00010000:00010000:2.0:1790100430.110073:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 50 pid: 9338 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100430.110179:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1790100430.110189:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184256450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+50:2422:x1877056127276928:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100430.110203:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100430.110210:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 50 pid: 9338 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.110223:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 50 pid: 9338 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.110244:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828703b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1a6 expref: 50 pid: 9338 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.110260:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:2.0:1790100430.110277:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.110287:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.110296:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.110324:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100430.110366:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.110379:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100430.110394:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000100:00100000:2.0:1790100430.110420:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184256450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+49:2422:x1877056127276928:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 231us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100430.110429:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00010000:00010000:3.0:1790100430.110518:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f2298287050 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 50 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.110530:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 49 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.110535:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100430.110537:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100430.110538:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:3.0:1790100430.110559:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+49:11243:x1877056127276800:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5082us (7354us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1790100430.110564:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1790100430.113248:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100430.113390:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127277184 00000100:00100000:2.0:1790100430.113399:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127277184 00000100:00100000:2.0:1790100430.113454:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1790100430.113464:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+49:11243:x1877056127277184:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1790100430.113669:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.113687:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.113698:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100430.113738:0:9338:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1790100430.113759:0:9338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088fe75a6 reply state 00000000a9898b4f transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.113772:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.113792:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:2.0:1790100430.113794:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100430.113798:0:9338:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100430.113934:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+52:11243:x1877056127277184:12345-192.168.203.13@tcp:36:bash.0 Request processed in 471us (694us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1790100430.114007:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000020:00080000:2.0:1790100430.114013:0:9338:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790100430.118177:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100430.118248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127277312 00000100:00100000:0.0:1790100430.118258:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127277312 00000100:00100000:0.0:1790100430.118311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1790100430.118320:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+52:11243:x1877056127277312:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790100430.118369:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100430.118388:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828706c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1bb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.118484:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.118499:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 53 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.118508:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.118537:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 53 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.118549:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 53 pid: 12139 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100430.118562:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140978560:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100430.118643:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261831d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100430.121939:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140978560:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100430.121968:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100430.122385:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100430.122584:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127277440 00000100:00100000:3.0:1790100430.122591:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127277440 00010000:00010000:3.0:1790100430.122623:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 54 pid: 12139 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100430.123637:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790100430.123673:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+54:2421:x1877056127277440:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100430.123689:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100430.123697:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 54 pid: 12139 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.123711:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 54 pid: 12139 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.123744:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287057 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1b4 expref: 54 pid: 12139 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.123760:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100430.123765:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.123775:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.123782:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.123803:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100430.123871:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+53:2421:x1877056127277440:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 203us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.123879:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00010000:00010000:0.0:1790100430.123958:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.123966:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100430.124025:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790100430.124030:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100430.124051:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.124080:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828706c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1bb expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.124106:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1bb expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.124113:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:0.0:1790100430.124116:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100430.124118:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47a00, rc 0) 00000100:00100000:0.0:1790100430.124142:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+52:11243:x1877056127277312:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5824us (5977us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100430.124149:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1790100430.127755:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100430.127835:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127277696 00000100:00100000:2.0:1790100430.127845:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127277696 00000100:00100000:2.0:1790100430.127899:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1790100430.127908:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+52:11243:x1877056127277696:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1790100430.128123:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+53:11243:x1877056127277696:12345-192.168.203.13@tcp:35:bash.0 Request processed in 215us (374us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1790100430.128131:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1790100430.204226:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100430.204317:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127277952 00000100:00100000:3.0:1790100430.204327:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127277952 00000100:00100000:3.0:1790100430.204415:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1790100430.204425:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+53:11253:x1877056127277952:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100430.204461:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100430.204480:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828707a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1c2 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100430.204573:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790100430.204661:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828707a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1c2 expref: 55 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.204675:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:3.0:1790100430.204678:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100430.204684:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828707a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1c2 expref: 55 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.204697:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:3.0:1790100430.204761:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+54:11253:x1877056127277952:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 337us (545us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1790100430.204769:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1790100430.207671:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100430.207757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127278080 00000100:00100000:1.0:1790100430.207767:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127278080 00000100:00100000:1.0:1790100430.207824:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:1.0:1790100430.207834:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+54:11253:x1877056127278080:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1790100430.207898:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208012:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208024:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208037:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208044:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208068:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208200:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208210:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208217:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100430.208261:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208272:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208278:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208284:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208289:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100430.208293:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208300:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208310:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100430.208318:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100430.208322:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208328:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f2298287088 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208639:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208646:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208653:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208657:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100430.208660:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208666:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208674:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:1.0:1790100430.208676:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100430.208680:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208686:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f229828708f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208696:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208707:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208713:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208718:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8fa00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100430.208721:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208727:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208734:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100430.208737:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100430.208740:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.208745:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287096 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100430.208843:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+54:11253:x1877056127278080:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1009us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100430.208851:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:3.0:1790100430.210674:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100430.210794:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127278336 00000100:00100000:2.0:1790100430.210803:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127278336 00000100:00100000:2.0:1790100430.210852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1790100430.210861:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+54:11253:x1877056127278336:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790100430.211234:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+55:11253:x1877056127278336:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 372us (566us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1790100430.211241:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1790100430.238042:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100430.238123:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127278592 00000100:00100000:0.0:1790100430.238133:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127278592 00000100:00100000:0.0:1790100430.238219:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:0.0:1790100430.238230:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+55:11256:x1877056127278592:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100430.238254:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100430.238274:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828709d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1c9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238360:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238375:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238386:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238412:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238419:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238425:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238525:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982870b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238535:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982870b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238542:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982870b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100430.238552:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790100430.238622:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238629:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238634:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238640:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100430.238644:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238662:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238673:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:0.0:1790100430.238676:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100430.238680:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238686:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982870a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238698:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238704:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238710:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238715:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100430.238718:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238723:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238729:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:0.0:1790100430.238731:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100430.238734:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238749:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982870ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238784:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828709d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1c9 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238797:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982870b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1c9 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.238805:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:0.0:1790100430.238808:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100430.238811:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:0.0:1790100430.238873:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+57:11256:x1877056127278592:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 644us (839us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1790100430.238881:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:1.0:1790100430.241617:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100430.241655:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100430.241738:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127278720 00000100:00100000:2.0:1790100430.241746:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127278720 00000100:00100000:2.0:1790100430.241804:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1790100430.241826:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+57:11256:x1877056127278720:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790100430.241886:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.241917:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.241930:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.241971:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.241979:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.241986:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.241992:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100430.241996:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.242004:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.242015:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:2.0:1790100430.242018:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100430.242023:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.242030:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982870c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100430.242107:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+57:11256:x1877056127278720:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 274us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100430.242115:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:3.0:1790100430.242308:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127278848 00000100:00100000:3.0:1790100430.242313:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127278848 00000100:00100000:3.0:1790100430.242379:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1790100430.242388:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+57:2420:x1877056127278848:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100430.242397:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100430.242411:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982870b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1c9 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.242433:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100430.242436:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100430.242456:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+56:2420:x1877056127278848:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 71us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.242463:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1790100430.245125:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100430.245275:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127279104 00000100:00100000:1.0:1790100430.245284:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127279104 00000100:00100000:1.0:1790100430.245357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:1.0:1790100430.245367:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+56:11256:x1877056127279104:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100430.245573:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+57:11256:x1877056127279104:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 207us (454us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1790100430.245581:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1790100430.280643:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140978688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100430.280709:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100430.280782:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100430.280793:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140978816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100430.280822:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100430.280825:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140978688 00000100:00100000:1.0:1790100430.280832:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140978688 00000100:00080000:3.0:1790100430.280905:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100430.285249:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140978816 00000100:00100000:2.0:1790100430.285266:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140978816 00000100:00100000:2.0:1790100430.285375:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790100430.285386:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140978688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790100430.285416:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100430.285494:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140978688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (4783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100430.285500:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790100430.285518:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790100430.285525:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140978816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100430.285537:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100430.285565:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140978816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (4742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100430.285571:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790100430.285622:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140978688:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790100430.289313:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100430.289441:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140978816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100430.364189:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100430.364315:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127279360 00000100:00100000:1.0:1790100430.364325:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127279360 00000100:00100000:1.0:1790100430.364413:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1790100430.364422:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+57:11274:x1877056127279360:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1790100430.364444:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100430.364462:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982870c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1d0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.364557:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982870ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.364572:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982870ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.364584:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982870ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100430.364594:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790100430.364681:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982870c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1d0 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.364699:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982870ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1d0 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.364737:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100430.364740:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790100430.364743:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f200, rc 0) 00000100:00100000:1.0:1790100430.364797:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11274:x1877056127279360:12345-192.168.203.13@tcp:101:cat.0 Request processed in 376us (617us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1790100430.364804:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1790100430.386278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100430.386366:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127279488 00000100:00100000:3.0:1790100430.386375:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127279488 00000100:00100000:3.0:1790100430.386431:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1790100430.386441:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11275:x1877056127279488:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100430.386463:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100430.386481:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1d7 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.386543:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982870e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.386557:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982870e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.386567:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982870e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100430.386624:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790100430.386628:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100430.386645:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982870e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.386669:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1d7 expref: 61 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.386685:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982870e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1d7 expref: 60 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.386693:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:3.0:1790100430.386696:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100430.386710:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:3.0:1790100430.386761:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11275:x1877056127279488:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 321us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.386768:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:2.0:1790100430.391846:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100430.391935:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127279872 00000100:00100000:1.0:1790100430.391946:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127279872 00000100:00100000:1.0:1790100430.391997:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1790100430.392004:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11275:x1877056127279872:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100430.392247:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11275:x1877056127279872:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 242us (410us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1790100430.392255:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1790100430.394048:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100430.394202:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127280000 00000100:00100000:2.0:1790100430.394210:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127280000 00000100:00100000:2.0:1790100430.394268:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1790100430.394291:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11275:x1877056127280000:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:2.0:1790100430.394305:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790100430.394328:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287073 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1bb expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.394379:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982870ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1d0 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.394394:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298286f70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e175 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.394404:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:2.0:1790100430.394409:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100430.394462:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+58:11275:x1877056127280000:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 170us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100430.394468:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1790100430.396600:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100430.396735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127280128 00000100:00100000:3.0:1790100430.396742:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127280128 00000100:00100000:3.0:1790100430.396792:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1790100430.396802:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+58:11275:x1877056127280128:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:3.0:1790100430.396971:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.396988:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.397000:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790100430.397295:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100430.397972:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1790100430.398060:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1790100430.398149:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+58:11275:x1877056127280128:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 1346us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.398168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1790100430.414751:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100430.414828:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127280256 00000100:00100000:3.0:1790100430.414838:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127280256 00000100:00100000:3.0:1790100430.414894:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1790100430.414904:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+58:11277:x1877056127280256:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100430.414924:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100430.414943:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982870f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1de expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415004:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415018:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415029:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415041:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415049:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415074:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415172:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415182:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415191:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100430.415230:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790100430.415235:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100430.415260:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415272:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415280:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415288:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415296:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415302:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100430.415307:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415321:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415333:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:3.0:1790100430.415336:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100430.415366:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415374:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982870f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415387:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415394:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415400:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415406:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100430.415409:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415416:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415423:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:3.0:1790100430.415425:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100430.415428:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415444:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f22982870ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415471:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982870f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415484:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100430.415491:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100430.415494:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100430.415496:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030c00, rc 0) 00000100:00100000:3.0:1790100430.415548:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11277:x1877056127280256:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 645us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.415559:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00010000:00010000:2.0:1790100430.664942:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100430.793884:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100430.793906:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140978944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100430.793970:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100430.794027:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140978944 00000100:00100000:3.0:1790100430.794033:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140978944 00000100:00100000:3.0:1790100430.794073:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790100430.794081:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140978944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100430.794136:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:3.0:1790100430.794197:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140978944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.794204:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790100430.794282:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140978944:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790100431.054851:0:14193:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100431.054861:0:14193:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100431.054886:0:14193:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790100431.054892:0:14193:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1790100431.114220:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100431.114230:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100431.114269:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790100431.114276:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790100431.114435:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b5df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140979072:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790100431.114783:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100431.120229:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.120261:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127280384 00000100:00100000:0.0:1790100431.120269:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127280384 00000100:00100000:3.0:1790100431.123484:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b5df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140979072:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790100431.123677:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1790100431.123693:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11289:x1877056127280384:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790100431.123723:0:12139:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790100431.123858:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11289:x1877056127280384:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 169us (3633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100431.123873:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00080000:0.0:1790100431.123898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100431.127007:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100431.128368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127280512 00000100:00100000:3.0:1790100431.128381:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127280512 00000100:00100000:3.0:1790100431.128512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1790100431.128523:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11289:x1877056127280512:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790100431.128586:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128602:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128617:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128670:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128679:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128705:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128733:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128743:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128750:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100431.128790:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790100431.128795:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100431.128809:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128820:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128827:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128834:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128841:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100431.128845:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128852:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128873:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:3.0:1790100431.128876:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100431.128881:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128888:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828710d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128900:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128906:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128912:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128917:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100431.128920:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128925:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128932:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9261900b4400) 00010000:00010000:3.0:1790100431.128935:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100431.128938:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128944:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f2298287114 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128967:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128974:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128980:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128985:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100431.128989:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.128995:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.129003:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100431.129005:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100431.129008:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.129014:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f229828711b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.133039:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11289:x1877056127280512:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 567us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100431.133054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:2.0:1790100431.133323:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100431.137530:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127280768 00000100:00100000:1.0:1790100431.137544:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127280768 00000100:00100000:1.0:1790100431.137605:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1790100431.137617:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11289:x1877056127280768:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100431.137637:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100431.137656:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287122 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1e5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138232:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138261:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138274:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100431.138285:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790100431.138813:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138822:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138829:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138835:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.138839:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138848:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138861:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100431.138864:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100431.138868:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138875:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138922:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287122 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1e5 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138938:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:1.0:1790100431.138941:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100431.138946:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287122 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1e5 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.138956:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8ec00, rc 0) 00000100:00100000:1.0:1790100431.139066:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11289:x1877056127280768:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1452us (5744us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1790100431.139075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1790100431.155848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100431.155892:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127280896 00000100:00100000:2.0:1790100431.155901:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127280896 00000100:00100000:2.0:1790100431.155961:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:2.0:1790100431.155969:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11289:x1877056127280896:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790100431.155997:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790100431.156089:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11289:x1877056127280896:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 120us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100431.156114:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:1.0:1790100431.172856:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100431.173034:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127281152 00000100:00100000:2.0:1790100431.173044:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127281152 00000100:00100000:2.0:1790100431.173111:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:2.0:1790100431.173121:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11289:x1877056127281152:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100431.173140:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100431.173143:0:9338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790100431.173176:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982870e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1d7 expref: 60 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.173193:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100431.173199:0:9338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100431.173211:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287137 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1ec expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100431.173575:0:9338:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1790100431.173713:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828713e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.173726:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828713e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.173736:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828713e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.173781:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287137 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1ec expref: 62 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.173812:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828713e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1ec expref: 61 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.173819:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926183194800) 00010000:00010000:2.0:1790100431.173821:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100431.173824:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927400, rc 0) 00000100:00100000:2.0:1790100431.173879:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11289:x1877056127281152:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 759us (1029us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1790100431.173886:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:3.0:1790100431.176728:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.176774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127281408 00000100:00100000:0.0:1790100431.176783:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127281408 00000100:00100000:0.0:1790100431.176855:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1790100431.176866:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11289:x1877056127281408:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100431.176927:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100431.176951:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828713e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1ec expref: 61 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.176969:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926183194800) 00010000:00010000:0.0:1790100431.176980:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100431.177000:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177013:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177022:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177074:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177084:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177091:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177138:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177166:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177175:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177181:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100431.177186:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177193:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177203:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:0.0:1790100431.177206:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100431.177209:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177216:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828714c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177226:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177232:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177238:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177251:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100431.177253:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177260:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177268:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xca1f8d62 (ffff926083e1b800) 00010000:00010000:0.0:1790100431.177271:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100431.177274:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.177279:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287153 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xca1f8d62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100431.177372:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11289:x1877056127281408:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 508us (649us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100431.177380:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:3.0:1790100431.179618:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.179707:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127281536 00000100:00100000:0.0:1790100431.179716:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127281536 00000100:00100000:0.0:1790100431.179770:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:0.0:1790100431.179780:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11289:x1877056127281536:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100431.179796:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100431.179817:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f229828715a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.179850:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.179883:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.179894:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.179986:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f229828715a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.180006:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.180014:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:0.0:1790100431.180017:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790100431.180021:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46800, rc 0) 00000100:00100000:0.0:1790100431.180081:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11289:x1877056127281536:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 301us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100431.180088:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:2.0:1790100431.182424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.184138:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127281792 00000100:00100000:0.0:1790100431.184163:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127281792 00000100:00100000:0.0:1790100431.184218:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:0.0:1790100431.184228:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11289:x1877056127281792:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100431.184302:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.184333:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.184370:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100431.184536:0:12139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1790100431.184546:0:12139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 282472206174ns, next at 283472203852ns, rc = 0 00000004:00010000:0.0:1790100431.184590:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c643c75c reply state 0000000053e86202 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.184604:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.184612:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:0.0:1790100431.184615:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790100431.184619:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100431.184707:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+63:11289:x1877056127281792:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 479us (2290us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1790100431.184714:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:2.0:1790100431.201715:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100431.201862:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127281920 00000100:00100000:2.0:1790100431.201872:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127281920 00000100:00100000:2.0:1790100431.202052:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:2.0:1790100431.202063:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+63:11289:x1877056127281920:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100431.202094:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100431.202112:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e1fa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.202176:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.202192:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.202223:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:2.0:1790100431.202226:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100431.202230:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926600, rc 0) 00000100:00100000:2.0:1790100431.202278:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+64:11289:x1877056127281920:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 217us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100431.202285:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:0.0:1790100431.205004:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100431.205066:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127282048 00000100:00100000:1.0:1790100431.205074:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127282048 00000100:00100000:1.0:1790100431.205197:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1790100431.205204:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2418:x1877056127282048:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1790100431.205235:0:8426:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:1.0:1790100431.205264:0:8426:0:(genops.c:1384:class_connect()) connect: client e84eb833-b466-4273-a7db-c12bb35adfb4, cookie 0xc87a4f2298287176 00002000:00100000:1.0:1790100431.205275:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e84eb833-b466-4273-a7db-c12bb35adfb4/ffff926184c3d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790100431.205289:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790100431.205593:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790100431.205770:0:8426:0:(import.c:65:import_set_state_nolock()) ffff926184c3b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100431.205820:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2418:x1877056127282048:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 Request processed in 616us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100431.205827:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1790100431.207037:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.207084:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127282176 00000100:00100000:0.0:1790100431.207092:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127282176 00000100:00100000:0.0:1790100431.207166:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1790100431.207174:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:0:x1877056127282176:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790100431.207366:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1790100431.208641:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1790100431.208648:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000100:00100000:2.0:1790100431.208781:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:0:x1877056127282176:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 1603us (1745us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790100431.208789:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1790100431.210500:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100431.210548:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127282432 00000100:00100000:1.0:1790100431.210556:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127282432 00000100:00100000:1.0:1790100431.210599:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790100431.210609:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+64:11289:x1877056127282432:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790100431.210812:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+65:11289:x1877056127282432:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 204us (315us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1790100431.210820:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1790100431.212457:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100431.212498:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127282688 00000100:00100000:2.0:1790100431.212506:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127282688 00000100:00100000:2.0:1790100431.212557:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:2.0:1790100431.212566:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+65:11289:x1877056127282688:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100431.212670:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+65:11289:x1877056127282688:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 106us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100431.212675:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:2.0:1790100431.215419:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.215482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127282816 00000100:00100000:0.0:1790100431.215490:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127282816 00000100:00100000:0.0:1790100431.215533:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1790100431.215552:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+65:11289:x1877056127282816:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100431.215568:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100431.215584:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828717d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e201 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.215636:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287184 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.215647:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.215655:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100431.215689:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100431.215705:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.215729:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828717d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e201 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.215746:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e201 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.215755:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:0.0:1790100431.215758:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790100431.215761:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46a00, rc 0) 00000100:00100000:0.0:1790100431.215808:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+66:11289:x1877056127282816:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 256us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100431.215824:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:3.0:1790100431.217211:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100431.217275:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127282944 00000100:00100000:1.0:1790100431.217284:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127282944 00000100:00100000:1.0:1790100431.217329:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1790100431.217415:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127282944:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100431.217429:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100431.217447:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e208 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100431.217469:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c3ce, blocks: 0x0 00010000:00010000:1.0:1790100431.217485:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=282s v=(0 0) 00010000:00010000:1.0:1790100431.217489:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100431.217497:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.217512:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.217524:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e000, rc 0) 00000100:00100000:1.0:1790100431.217577:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127282944:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 240us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100431.217592:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1790100431.219617:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100431.219668:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127283200 00000100:00100000:2.0:1790100431.219676:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127283200 00000100:00100000:2.0:1790100431.219741:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1790100431.219748:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+66:11289:x1877056127283200:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100431.219821:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+66:11289:x1877056127283200:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100431.219839:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:3.0:1790100431.223980:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100431.224041:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127283328 00000100:00100000:1.0:1790100431.224050:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127283328 00000100:00100000:1.0:1790100431.224102:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1790100431.224112:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:11289:x1877056127283328:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100431.224130:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100431.224157:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e20f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.224191:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.224208:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100431.224212:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100431.224216:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.224248:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.224257:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 7 pid: 8427 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100431.224268:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140979200:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100431.224381:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6141000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100431.225928:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140979200:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100431.225954:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.225971:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8ee00, rc 0) 00000100:00100000:1.0:1790100431.226013:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:11289:x1877056127283328:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1902us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100431.226021:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1790100431.226968:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100431.227065:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127283456 00000100:00100000:2.0:1790100431.227071:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127283456 00010000:00010000:2.0:1790100431.227102:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 7 pid: 8427 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100431.227140:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1790100431.227161:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127283456:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100431.227173:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100431.227191:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 7 pid: 8427 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.227213:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 7 pid: 8427 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.227234:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091cc6899/0xc87a4f229828718b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e208 expref: 7 pid: 8427 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.227253:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100431.227257:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100431.227265:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.227274:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.227332:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100431.227375:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6498:1877056140979328:192.168.203.13@tcp:105: 00000100:00100000:2.0:1790100431.227442:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100431.233439:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100431.233613:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127283584 00000100:00100000:1.0:1790100431.233621:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127283584 00002000:00100000:1.0:1790100431.233661:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9260831bed80 x1877056127283584/t0(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:727/0 lens 504/0 e 0 to 0 dl 1790100442 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100431.233672:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9260831bed80 with x1877056127283584 ext(0->8) 00002000:00010000:1.0:1790100431.233678:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9260831bed80 00000100:00100000:2.0:1790100431.233694:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6498:1877056140979328:192.168.203.13@tcp:105: 00000100:00100000:1.0:1790100431.233711:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00010000:00010000:2.0:1790100431.233716:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100431.233721:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127283584:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790100431.233773:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127283456:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 6624us (6806us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100431.233782:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1790100431.236336:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127283584:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 2607us (2894us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1790100431.236374:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:1.0:1790100431.236387:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9260831bed80 x1877056127283584/t4294967303(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:727/0 lens 504/448 e 0 to 0 dl 1790100442 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100431.236397:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9260831bed80 with x1877056127283584 ext(0->8) 00002000:00010000:1.0:1790100431.236404:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9260831bed80 00000100:00100000:3.0:1790100431.239585:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100431.239673:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127283712 00000100:00100000:2.0:1790100431.239683:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127283712 00000100:00100000:2.0:1790100431.239748:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:2.0:1790100431.239757:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+66:11289:x1877056127283712:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790100431.242013:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1790100431.242029:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1790100431.242116:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1790100431.242292:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140979456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790100431.242382:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100431.242446:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140979456 00000100:00100000:2.0:1790100431.242453:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140979456 00000100:00100000:2.0:1790100431.242493:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790100431.242502:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140979456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790100431.242615:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790100431.242620:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790100430 00002000:00010000:2.0:1790100431.242622:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790100431.242624:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790100430 -> 1790100430 00002000:00010000:2.0:1790100431.242638:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1790100431.242679:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140979456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (296us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790100431.242686:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:2.0:1790100431.242897:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff926083cd0a80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790100431.242904:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140979456:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1790100431.243029:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243046:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243053:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243059:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.243064:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243072:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243104:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff926083b64700) 00010000:00010000:1.0:1790100431.243108:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100431.243113:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243119:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298286eac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243138:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243145:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243162:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243168:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.243177:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243184:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243192:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100431.243195:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100431.243198:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243204:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298286eb3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243216:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243227:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243233:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243237:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.243240:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243246:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243253:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083b64300) 00010000:00010000:1.0:1790100431.243255:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100431.243264:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243270:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298286ef2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243285:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243291:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243297:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243301:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.243304:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243309:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243318:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100431.243320:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100431.243323:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243328:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c600/0xc87a4f2298286ffc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243372:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243379:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243392:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243397:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.243401:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243407:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243416:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100431.243418:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100431.243421:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243427:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828701f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243439:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243445:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243451:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243456:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.243459:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243475:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243484:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100431.243486:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100431.243489:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243494:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f2298287065 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243506:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243513:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243519:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243524:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.243527:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243532:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243539:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:1.0:1790100431.243541:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100431.243543:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.243559:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287168 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100431.243908:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140979584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790100431.243951:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100431.244054:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140979584 00000100:00100000:1.0:1790100431.244060:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140979584 00000100:00100000:1.0:1790100431.244121:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790100431.244129:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1877056140979584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790100431.244159:0:10090:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1790100431.244189:0:10090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6ab2c3cc, atime: 0x6ab2c3cc, ctime: 0x6ab2c3cc, blocks: 0x8 00010000:00010000:1.0:1790100431.244196:0:10090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.244208:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=282s v=(0 0) 00010000:00010000:1.0:1790100431.244212:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100431.244218:0:10090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.244232:0:10090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.244241:0:10090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.244248:0:10090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.244277:0:10090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1790100431.244444:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1790100431.244619:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9261947be600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1790100431.244625:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083cd5000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9261947be000 00000020:00080000:0.0:1790100431.244628:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083cd5600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92608387b800 00000100:00100000:0.0:1790100431.244761:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+14:11289:x1877056127283712:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 5003us (5182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100431.244771:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:0.0:1790100431.246751:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100431.246827:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127283840 00000100:00100000:3.0:1790100431.246836:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127283840 00000100:00100000:3.0:1790100431.246886:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1790100431.246897:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2420:x1877056127283840:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790100431.248217:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1790100431.248227:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1790100431.248590:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2420:x1877056127283840:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 1690us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100431.248600:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00010000:00010000:3.0:1790100431.249482:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100431.249494:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.249508:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8fe00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100431.249513:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.249525:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.249547:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.249556:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e412219/0xc87a4f2298287199 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.249590:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100431.249592:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100431.249594:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100431.249742:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1877056140979584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5610us (5786us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790100431.249752:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00080000:1.0:1790100431.249787:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1790100431.249958:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790100431.254633:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100431.254726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127284096 00000100:00100000:3.0:1790100431.254736:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127284096 00000100:00100000:3.0:1790100431.254796:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:3.0:1790100431.254806:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+14:11289:x1877056127284096:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790100431.254857:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100431.254881:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287184 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e201 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.254910:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:3.0:1790100431.254916:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100431.254942:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.254954:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.254963:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100431.255066:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033ea2ab9 reply state 00000000fd87d99c transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.255078:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.255443:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:3.0:1790100431.255446:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790100431.255449:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100431.255538:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+15:11289:x1877056127284096:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 733us (912us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1790100431.255546:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000004:00080000:2.0:1790100431.257289:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9260831bc000/2, rc 0, transno 4294967302 00000100:00100000:2.0:1790100431.257302:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140979584:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790100431.267114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.267262:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127284224 00000100:00100000:0.0:1790100431.267272:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127284224 00000100:00100000:0.0:1790100431.267331:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1790100431.267372:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127284224:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790100431.267520:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790100431.267525:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790100430 -> 1790100429 00002000:00010000:0.0:1790100431.267527:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790100428 00002000:00010000:0.0:1790100431.267530:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790100430 -> 1790100429 00002000:00010000:0.0:1790100431.267532:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1790100431.267595:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127284224:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 254us (494us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790100431.267616:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1790100431.275051:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100431.275266:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127284480 00000100:00100000:2.0:1790100431.275276:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127284480 00000100:00100000:2.0:1790100431.275336:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:2.0:1790100431.275387:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+15:11289:x1877056127284480:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790100431.275447:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.275464:0:9338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.275473:0:9338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.275504:0:9338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.275517:0:9338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100431.275543:0:9338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eec380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9338:1877056140979712:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100431.275647:0:9338:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100431.279638:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.279825:0:9338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eec380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9338:1877056140979712:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100431.279851:0:9338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.279942:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127284608 00000100:00100000:3.0:1790100431.279949:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127284608 00010000:00010000:3.0:1790100431.279986:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.280058:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1790100431.280067:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+16:2421:x1877056127284608:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100431.280081:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100431.280094:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.280215:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.280236:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287161 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1f3 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.280253:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:3.0:1790100431.280257:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.280280:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.280287:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.280315:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100431.280406:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+15:2421:x1877056127284608:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 339us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100431.280413:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00010000:00010000:2.0:1790100431.280522:0:9338:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.280529:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.280565:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.280572:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.280579:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.280585:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100431.280589:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.280596:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.280604:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:2.0:1790100431.280607:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790100431.280610:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.280626:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982871a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100431.280668:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+14:11289:x1877056127284480:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 5284us (5626us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790100431.280675:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:3.0:1790100431.283642:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.283732:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127284736 00000100:00100000:0.0:1790100431.283741:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127284736 00000100:00100000:0.0:1790100431.283789:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1790100431.283799:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127284736:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790100431.283839:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.283858:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.283867:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100431.283871:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100431.283876:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.283920:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.283934:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 7 pid: 8425 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100431.283968:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140979840:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100431.284041:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff926184ed36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100431.286936:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100431.287011:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127284864 00000100:00100000:1.0:1790100431.287020:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127284864 00010000:00010000:1.0:1790100431.287056:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 8 pid: 8425 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100431.287222:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1790100431.287232:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127284864:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100431.287247:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100431.287267:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 8 pid: 8425 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.287280:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 8 pid: 8425 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.287303:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100431.287306:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100431.287311:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.287320:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.287367:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100431.287413:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127284864:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 183us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100431.287433:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00010000:00010000:0.0:1790100431.287957:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298287192 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e20f expref: 7 pid: 8425 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100431.287974:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140979840:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100431.287993:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288004:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288011:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288030:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288039:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288046:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288067:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100431.288072:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288081:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288255:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.288263:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1a05b9b/0xc87a4f22982871ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100431.288325:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2419:x1877056127284736:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 4528us (4691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100431.288334:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1790100431.291056:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.291194:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127285120 00000100:00100000:0.0:1790100431.291203:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127285120 00000100:00100000:0.0:1790100431.291260:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:0.0:1790100431.291270:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+14:11289:x1877056127285120:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790100431.291379:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.291396:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.291427:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.291459:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.291472:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 14 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100431.291487:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140979968:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100431.291554:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff926184ed36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100431.296377:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100431.296467:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140979968:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100431.296491:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.296571:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127285248 00000100:00100000:3.0:1790100431.296577:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127285248 00010000:00010000:3.0:1790100431.296609:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.296641:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:3.0:1790100431.296650:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184257850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+15:2422:x1877056127285248:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100431.296662:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100431.296668:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.296680:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.296698:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298286ff5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e198 expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.296727:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100431.296732:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.296741:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.296749:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.296993:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100431.297043:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184257850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+14:2422:x1877056127285248:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 393us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100431.297051:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00010000:00010000:0.0:1790100431.297776:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.297784:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.298662:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.298677:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.298685:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.298722:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.298736:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 14 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100431.298749:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140980096:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100431.298854:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff926184ed3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100431.301735:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100431.301796:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127285376 00000100:00100000:3.0:1790100431.301804:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127285376 00010000:00010000:3.0:1790100431.301840:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 15 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.301877:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1790100431.301887:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+15:2421:x1877056127285376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100431.301909:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100431.301915:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 15 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.301927:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 15 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.301960:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:3.0:1790100431.301965:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.301973:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.301980:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.301997:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100431.302040:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+15:2421:x1877056127285376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 155us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100431.302047:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00010000:00010000:0.0:1790100431.302512:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828716f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1fa expref: 14 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100431.302527:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140980096:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100431.302546:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.302554:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100431.302560:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100431.302646:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1790100431.302734:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1790100431.302762:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1790100431.302838:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1877056140980224:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790100431.302877:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100431.302907:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839cd780 going to sleep for 11 seconds 00000100:00100000:2.0:1790100431.302966:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140980224 00000100:00100000:2.0:1790100431.302971:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140980224 00000100:00100000:2.0:1790100431.303007:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790100431.303016:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1877056140980224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790100431.303225:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1877056140980224:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100431.303233:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790100431.303314:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1790100431.303319:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff926083cd0a80, transno 4294967304 00000100:00100000:0.0:1790100431.303334:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1877056140980224:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1790100431.303452:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1790100431.303483:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1877056140980352:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790100431.303506:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100431.303526:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff926184ed3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100431.303603:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140980352 00000100:00100000:3.0:1790100431.303607:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140980352 00000100:00100000:3.0:1790100431.303634:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790100431.303640:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1877056140980352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790100431.303731:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6513:x1877056140980352:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (222us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790100431.303737:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790100431.303800:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1877056140980352:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1790100431.303829:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303837:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303844:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303849:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.303853:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303860:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303883:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:1.0:1790100431.303886:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100431.303891:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303897:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982871bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303934:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303941:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303946:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303951:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.303954:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303960:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303967:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100431.303970:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100431.303972:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.303978:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982870ea lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.304008:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.304019:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.304027:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.304049:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.304060:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 17 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100431.304070:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140980480:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100431.304134:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a61410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100431.306483:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140980480:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100431.306505:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100431.306621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100431.306771:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127285504 00000100:00100000:3.0:1790100431.306778:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127285504 00010000:00010000:3.0:1790100431.306810:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.306853:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:3.0:1790100431.306863:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2422:x1877056127285504:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100431.306896:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100431.306903:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.306915:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.306937:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f2298287106 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e1de expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.306956:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:3.0:1790100431.306961:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.306970:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.306977:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.307005:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100431.307026:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.307035:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.307045:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.307053:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+17:2422:x1877056127285504:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 191us (430us total) trans 0 rc 0/0 00010000:00010000:1.0:1790100431.307063:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100431.307069:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00010000:00010000:1.0:1790100431.307076:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311677:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.311687:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311707:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311724:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100431.311727:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100431.311732:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311738:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982871c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311756:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311762:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311768:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311773:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100431.311790:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311796:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311811:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff926083b64200) 00010000:00010000:1.0:1790100431.311814:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100431.311817:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100431.311823:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f22982871b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100431.312007:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+16:11289:x1877056127285120:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 20735us (20955us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1790100431.312018:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000020:00080000:1.0:1790100431.312023:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790100431.312719:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100431.312724:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100431.312738:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790100431.312744:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100431.313543:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100431.313673:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127285760 00000100:00100000:3.0:1790100431.313698:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127285760 00000100:00100000:3.0:1790100431.313774:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1790100431.313784:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+16:11289:x1877056127285760:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790100431.314011:0:6516:0:(mdd_object.c:4178:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790100431.314041:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1790100431.314070:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.314084:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.314156:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.314166:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.314176:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.314182:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100431.314195:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790100431.314276:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:11289:x1877056127285760:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 493us (735us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1790100431.314284:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000020:00080000:3.0:1790100431.314288:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100431.314329:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100431.314335:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.314369:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100431.314373:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.314380:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.314392:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:2.0:1790100431.314395:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790100431.314400:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.314417:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982871ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100431.314430:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100431.314432:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100431.314433:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100431.700885:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100431.819577:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100431.819604:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140980608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100431.819673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100431.820187:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140980608 00000100:00100000:2.0:1790100431.820195:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140980608 00000100:00100000:2.0:1790100431.820269:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790100431.820279:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140980608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100431.820309:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100431.820400:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140980608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100431.820407:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790100431.820589:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140980608:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1790100432.137106:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790100432.331374:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140980736:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.331441:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.331492:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140981248:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.331522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100432.331531:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140981120:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.331546:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140981760:0@lo:400:kworker.0 00000100:00100000:3.0:1790100432.331571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.331582:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140980992:0@lo:400:kworker.0 00000040:00080000:2.0:1790100432.331847:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100432.331851:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100432.331869:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790100432.331875:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100432.331930:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140980736 00000100:00100000:2.0:1790100432.331937:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140980736 00000100:00100000:2.0:1790100432.331983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1790100432.331993:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140980736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332061:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.332082:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140981504:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332107:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.332124:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140982016:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332155:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.332176:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1790100432.332182:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056140980864:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332201:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.332226:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056140981376:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332246:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.332261:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140981888:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.332311:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b8eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140982400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100432.332333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.332381:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140981248 00000100:00100000:0.0:1790100432.332385:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140981248 00000100:00100000:0.0:1790100432.332413:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140981120 00000100:00100000:0.0:1790100432.332416:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140981120 00000100:00100000:0.0:1790100432.332426:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140980864 00000100:00100000:0.0:1790100432.332428:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140980864 00000100:00100000:0.0:1790100432.332436:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140981376 00000100:00100000:0.0:1790100432.332438:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140981376 00000100:00100000:0.0:1790100432.332449:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140981888 00000100:00100000:0.0:1790100432.332452:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140981888 00000100:00100000:0.0:1790100432.332465:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1790100432.332471:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140981248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332504:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056140981248:12345-0@lo:400:kworker.0 Request processed in 33us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.332510:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1790100432.332527:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1790100432.332533:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140981120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332560:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140981120:12345-0@lo:400:kworker.0 Request processed in 28us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.332566:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1790100432.332577:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1790100432.332583:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056140980864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332626:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056140980864:12345-0@lo:400:kworker.0 Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.332633:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1790100432.332648:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1790100432.332655:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056140981376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332683:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056140981376:12345-0@lo:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.332688:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1790100432.332700:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1790100432.332706:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140981888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332731:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056140981888:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.332736:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1790100432.332762:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140982400 00000100:00100000:0.0:1790100432.332766:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140982400 00000100:00100000:0.0:1790100432.332791:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100432.332797:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1877056140982400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100432.332818:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100432.332848:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1877056140982400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.332854:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100432.332874:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140980992 00000100:00100000:0.0:1790100432.332878:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140980992 00000100:00100000:0.0:1790100432.332907:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790100432.332914:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140980992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.332943:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140980992:12345-0@lo:400:kworker.0 Request processed in 30us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.332955:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790100432.332993:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056140980864:0@lo:400:kworker.0 00010000:00080000:0.0:1790100432.333007:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b2572300 x1877056140981376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100432.333018:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056140981376:0@lo:400:kworker.0 00010000:00080000:0.0:1790100432.333026:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6368a80 x1877056140981888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100432.333035:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056140981888:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.333049:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b8eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140982400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100432.333059:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140980992:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.333086:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140981504 00000100:00100000:0.0:1790100432.333090:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140981504 00000100:00100000:0.0:1790100432.333120:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140982016 00000100:00100000:0.0:1790100432.333123:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140982016 00000100:00100000:0.0:1790100432.333152:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100432.333159:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140981504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.333194:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140981504:12345-0@lo:400:kworker.0 Request processed in 36us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.333199:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100432.333217:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100432.333223:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140982016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.333248:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140982016:12345-0@lo:400:kworker.0 Request processed in 25us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.333262:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100432.333292:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140981504:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.333302:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140982016:0@lo:400:kworker.0 00000100:00080000:0.0:1790100432.333380:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100432.333385:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100432.333387:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100432.333389:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100432.333406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100432.333436:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140982272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100432.333450:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140981760 00000100:00100000:1.0:1790100432.333456:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140981760 00000100:00100000:0.0:1790100432.333467:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100432.333498:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790100432.333503:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056140981248:0@lo:400:kworker.0 00000100:00100000:1.0:1790100432.333510:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140981760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.333535:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140982272 00000100:00100000:0.0:1790100432.333540:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140982272 00000100:00100000:1.0:1790100432.333559:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877056140981760:12345-0@lo:400:kworker.0 Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100432.333567:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790100432.333571:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790100432.333581:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140982272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100432.333593:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100432.333742:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140981120:0@lo:400:kworker.0 00000100:00100000:2.0:1790100432.333744:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3642:x1877056140980736:12345-0@lo:400:kworker.0 Request processed in 1751us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100432.333754:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140981632:0@lo:400:kworker.0 00000100:00100000:2.0:1790100432.333759:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:2.0:1790100432.333806:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100432.333870:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140982272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 291us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.333877:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790100432.333903:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140982272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100432.333913:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056140980736:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.333922:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1877056140981760:0@lo:400:kworker.0 00000100:00100000:3.0:1790100432.336335:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100432.336396:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140982144:0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.336401:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140981632 00000100:00100000:0.0:1790100432.336414:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140981632 00000100:00100000:3.0:1790100432.336431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790100432.336517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100432.336580:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140982144 00000100:00100000:1.0:1790100432.336585:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140982144 00000100:00100000:0.0:1790100432.336585:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790100432.336596:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056140981632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.336661:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056140981632:12345-0@lo:400:kworker.0 Request processed in 68us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.336668:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790100432.336684:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790100432.336690:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056140982144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100432.336716:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056140982144:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.336721:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790100432.336789:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140981632:0@lo:400:kworker.0 00000100:00100000:2.0:1790100432.336802:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140982144:0@lo:400:kworker.0 00010000:00010000:3.0:1790100432.712978:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100432.784906:0:14244:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100432.784916:0:14244:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100432.784941:0:14244:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790100432.784946:0:14244:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100432.917229:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100432.917300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127286016 00000100:00100000:1.0:1790100432.917310:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127286016 00000100:00100000:1.0:1790100432.917385:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1790100432.917394:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:11307:x1877056127286016:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100432.917414:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100432.917432:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e600/0xc87a4f22982871d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e216 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.917523:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f22982871d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.917537:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f22982871d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.917549:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f22982871d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100432.917560:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790100432.917651:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e600/0xc87a4f22982871d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e216 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.917667:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f22982871d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e216 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.917675:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100432.917678:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100432.917681:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f000, rc 0) 00000100:00100000:1.0:1790100432.917731:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+20:11307:x1877056127286016:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 338us (511us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1790100432.917738:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1790100432.921240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100432.926236:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127286144 00000100:00100000:3.0:1790100432.926252:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127286144 00000100:00100000:3.0:1790100432.926313:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:3.0:1790100432.926324:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+20:11307:x1877056127286144:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1790100432.926410:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926426:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926437:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926451:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926459:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926465:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926539:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926548:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926556:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100432.926595:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926607:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926613:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926620:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926626:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100432.926630:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926638:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926649:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:3.0:1790100432.926652:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100432.926658:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926670:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982871e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926684:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926691:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926696:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926700:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100432.926703:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926709:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926716:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9261900b4800) 00010000:00010000:3.0:1790100432.926719:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100432.926722:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926727:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982871ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926743:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926748:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926760:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926765:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100432.926768:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926774:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926782:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9261900b4d00) 00010000:00010000:3.0:1790100432.926784:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100432.926787:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.926792:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982871f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100432.926860:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+20:11307:x1877056127286144:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 538us (5625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100432.926867:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:2.0:1790100432.969751:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100432.969907:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127286400 00000100:00100000:1.0:1790100432.969917:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127286400 00000100:00100000:1.0:1790100432.969975:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:1.0:1790100432.969986:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+20:11310:x1877056127286400:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100432.970004:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100432.970020:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e600/0xc87a4f22982871fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e21d expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970097:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970112:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970124:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970146:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970153:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970159:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970257:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970265:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970286:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100432.970296:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790100432.970381:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970389:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970395:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970400:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8fa00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100432.970404:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970410:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970420:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100432.970423:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100432.970426:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970432:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287202 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970442:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970448:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970460:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970466:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100432.970469:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970474:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970483:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff92619461fe00) 00010000:00010000:1.0:1790100432.970485:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100432.970488:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970494:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287209 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970531:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e600/0xc87a4f22982871fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 23 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970545:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 22 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100432.970551:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:1.0:1790100432.970552:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100432.970555:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f200, rc 0) 00000100:00100000:1.0:1790100432.970603:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+22:11310:x1877056127286400:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 619us (860us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1790100432.970619:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:0.0:1790100432.980587:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100432.980659:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127286528 00000100:00100000:2.0:1790100432.980668:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127286528 00000100:00100000:2.0:1790100432.980734:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:2.0:1790100432.980744:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+22:11310:x1877056127286528:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790100432.980805:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980821:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980831:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980861:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980867:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980873:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980879:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100432.980884:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980905:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980916:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:2.0:1790100432.980919:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100432.980924:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100432.980931:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828721e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100432.981000:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+22:11310:x1877056127286528:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 258us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100432.981007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:2.0:1790100432.986561:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100432.986640:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127286784 00000100:00100000:0.0:1790100432.986650:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127286784 00000100:00100000:0.0:1790100432.986706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790100432.986717:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+22:11310:x1877056127286784:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1790100432.986980:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+23:11310:x1877056127286784:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 264us (426us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1790100432.986988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790100433.005531:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.005568:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127287040 00000100:00100000:0.0:1790100433.005578:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127287040 00000100:00100000:0.0:1790100433.005644:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:0.0:1790100433.005653:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+23:10830:x1877056127287040:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790100433.005675:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100433.005692:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287225 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e224 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.005811:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.005828:0:9338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 24 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.005837:0:9338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.005869:0:9338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 24 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.005883:0:9338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 24 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.005897:0:9338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084810e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9338:1877056140982528:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100433.005974:0:9338:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80c00 going to sleep for 11 seconds 00000100:00080000:2.0:1790100433.012737:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100433.022903:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.022945:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127287168 00000100:00100000:0.0:1790100433.022954:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127287168 00010000:00010000:0.0:1790100433.023260:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 25 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.023307:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1790100433.023317:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+25:2422:x1877056127287168:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100433.023331:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100433.023361:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 25 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.023376:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 25 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.023396:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:0.0:1790100433.023402:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.023412:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.023420:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.023571:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100433.023779:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+25:2422:x1877056127287168:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 462us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.023786:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00010000:00010000:0.0:1790100433.023829:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287210 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e21d expref: 24 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.023841:0:9338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084810e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9338:1877056140982528:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100433.023861:0:9338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.023869:0:9338:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.023884:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100433.023901:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790100433.024021:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287225 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 25 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.024035:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 24 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.024042:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:0.0:1790100433.024046:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790100433.024048:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:0.0:1790100433.024074:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+24:10830:x1877056127287040:12345-192.168.203.13@tcp:101:bash.0 Request processed in 18422us (18550us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1790100433.024098:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1790100433.029645:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.029683:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127287296 00000100:00100000:2.0:1790100433.029692:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127287296 00000100:00100000:2.0:1790100433.029741:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:2.0:1790100433.029751:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+24:10830:x1877056127287296:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100433.029774:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.029792:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828723a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e22b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.029825:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.029839:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.029857:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.029954:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828723a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e22b expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.032202:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e22b expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.032215:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:2.0:1790100433.032218:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100433.032222:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926e00, rc 0) 00000100:00100000:2.0:1790100433.032289:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+25:10830:x1877056127287296:12345-192.168.203.13@tcp:101:bash.0 Request processed in 2539us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.032297:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:2.0:1790100433.035266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.035794:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127287552 00000100:00100000:0.0:1790100433.035804:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127287552 00000100:00100000:0.0:1790100433.035863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:0.0:1790100433.035873:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+25:10830:x1877056127287552:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:0.0:1790100433.036082:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.036194:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.036207:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100433.036263:0:6514:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1790100433.036285:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cdb9521 reply state 000000009112e502 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.036298:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.036306:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:0.0:1790100433.036309:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790100433.036312:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790100433.036611:0:6514:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1790100433.036858:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+29:10830:x1877056127287552:12345-192.168.203.13@tcp:36:bash.0 Request processed in 984us (1597us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1790100433.036866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000020:00080000:0.0:1790100433.036871:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790100433.041892:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.041952:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127287680 00000100:00100000:0.0:1790100433.041961:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127287680 00000100:00100000:0.0:1790100433.042011:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1790100433.042022:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+29:10830:x1877056127287680:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790100433.042044:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100433.042061:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828724f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e232 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.042181:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828724f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e232 expref: 30 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.042195:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828724f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e232 expref: 30 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.042226:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:0.0:1790100433.042230:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790100433.042234:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46c00, rc 0) 00000100:00100000:0.0:1790100433.042288:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+30:10830:x1877056127287680:12345-192.168.203.13@tcp:101:bash.0 Request processed in 268us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.042295:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:2.0:1790100433.048398:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.048428:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127287808 00000100:00100000:2.0:1790100433.048449:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127287808 00000100:00100000:2.0:1790100433.048505:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1790100433.048514:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:10830:x1877056127287808:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100433.048530:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.048548:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e239 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100433.048572:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6ab2c3cd, atime: 0x6ab2c3cc, ctime: 0x6ab2c3cd, blocks: 0x8 00010000:00010000:2.0:1790100433.048601:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=284s v=(0 0) 00010000:00010000:2.0:1790100433.048605:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100433.048613:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.048631:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.048642:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927e00, rc 0) 00000100:00100000:2.0:1790100433.048688:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:10830:x1877056127287808:12345-192.168.203.13@tcp:101:bash.0 Request processed in 175us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.048694:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00080000:2.0:1790100433.048729:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100433.055249:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.055392:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127287936 00000100:00100000:2.0:1790100433.055402:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127287936 00002000:00010000:2.0:1790100433.055439:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1790100433.055444:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926083b72680 with x1877056127287936 ext(0->18446744073709551615) 00002000:00010000:2.0:1790100433.055455:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926083b72680. 00000100:00100000:2.0:1790100433.055482:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1790100433.055491:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2421:x1877056127287936:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:2.0:1790100433.055728:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790100433.055732:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790100429 -> 1790100432 00002000:00010000:2.0:1790100433.055734:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1790100428 -> 1790100428 00002000:00010000:2.0:1790100433.055737:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790100429 -> 1790100432 00002000:00010000:2.0:1790100433.055739:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1790100433.055794:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127287936:12345-192.168.203.13@tcp:10:bash.0 Request processed in 304us (553us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790100433.055809:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00010000:2.0:1790100433.055814:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1790100433.055816:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926083b72680 with x1877056127287936 ext(0->18446744073709551615) 00002000:00010000:2.0:1790100433.055821:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926083b72680. 00000100:00100000:3.0:1790100433.099463:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.099573:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127288064 00000100:00100000:0.0:1790100433.099584:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127288064 00000100:00100000:0.0:1790100433.099644:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1790100433.099660:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+30:11324:x1877056127288064:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1790100433.099726:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099743:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099768:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099783:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099790:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099797:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099865:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099886:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099894:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100433.099936:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099960:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099967:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099973:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099980:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100433.099984:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.099993:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100005:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:0.0:1790100433.100009:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100433.100013:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100019:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828725d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100038:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100044:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100050:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100055:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100433.100058:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100064:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100070:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083e1be00) 00010000:00010000:0.0:1790100433.100072:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100433.100074:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.100080:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.102463:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.102479:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.102486:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.102508:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100433.102512:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.102521:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.102550:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:0.0:1790100433.102554:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100433.102559:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.102570:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828726b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.102677:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+30:11324:x1877056127288064:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 3019us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.102686:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:2.0:1790100433.139883:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.140115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127288320 00000100:00100000:0.0:1790100433.140124:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127288320 00000100:00100000:0.0:1790100433.140190:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:0.0:1790100433.140200:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+30:11327:x1877056127288320:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100433.140219:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100433.140238:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287272 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e240 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140307:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140371:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140384:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140400:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140408:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140414:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140509:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287287 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140519:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140525:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100433.140534:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790100433.140605:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140613:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140620:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140631:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100433.140635:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140643:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140654:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:0.0:1790100433.140657:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100433.140662:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140669:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287279 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140696:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140703:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140709:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140714:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100433.140717:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140723:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140742:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083e1be00) 00010000:00010000:0.0:1790100433.140744:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100433.140748:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140753:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287280 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140793:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287272 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e240 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140807:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e240 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.140815:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:0.0:1790100433.140817:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790100433.140820:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46800, rc 0) 00000100:00100000:0.0:1790100433.140879:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+32:11327:x1877056127288320:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 680us (1004us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1790100433.140887:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:1.0:1790100433.144549:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.144636:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127288448 00000100:00100000:0.0:1790100433.144646:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127288448 00000100:00100000:0.0:1790100433.144799:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1790100433.144810:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+32:11327:x1877056127288448:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1790100433.144871:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.144888:0:9338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 32 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.144914:0:9338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.144946:0:9338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 32 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.144958:0:9338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 32 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.144971:0:9338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084810e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9338:1877056140982656:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100433.145059:0:9338:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790100433.147841:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100433.147868:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127288704 00000100:00100000:3.0:1790100433.147876:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127288704 00000100:00100000:3.0:1790100433.147931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1790100433.147940:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+33:6182:x1877056127288704:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790100433.148198:0:9338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084810e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9338:1877056140982656:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100433.148224:0:9338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100433.148960:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+34:6182:x1877056127288704:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 1018us (1124us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1790100433.148981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1790100433.154005:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100433.154171:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127288832 00000100:00100000:1.0:1790100433.154182:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127288832 00010000:00010000:1.0:1790100433.154222:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 34 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100433.154263:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1790100433.154273:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+34:2421:x1877056127288832:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100433.154287:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100433.154294:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 34 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.154306:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 34 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.154325:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828722c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e224 expref: 34 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.154356:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:1.0:1790100433.154362:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.154384:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.154392:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.154564:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100433.154610:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+33:2421:x1877056127288832:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 339us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100433.154617:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00010000:00010000:2.0:1790100433.156245:0:9338:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.156260:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.156300:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.156307:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.156314:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.156320:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.156325:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.156332:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.156430:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:2.0:1790100433.156433:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100433.156438:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.156458:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287295 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.156562:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+32:11327:x1877056127288448:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 11752us (12663us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.156572:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:2.0:1790100433.159011:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.159266:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127289088 00000100:00100000:0.0:1790100433.159276:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127289088 00000100:00100000:0.0:1790100433.159824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1790100433.159836:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+32:11327:x1877056127289088:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1790100433.160198:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+33:11327:x1877056127289088:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 364us (1193us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1790100433.160206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1790100433.246183:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.246291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127289344 00000100:00100000:0.0:1790100433.246300:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127289344 00000100:00100000:0.0:1790100433.246400:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:0.0:1790100433.246412:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+33:11338:x1877056127289344:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1790100433.246437:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100433.246457:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828729c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e247 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246549:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246564:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246576:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246591:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246599:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246607:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246721:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982872b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246731:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982872b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246740:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982872b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100433.246749:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1790100433.246819:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246827:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246839:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246846:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100433.246850:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246859:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246870:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:0.0:1790100433.246874:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100433.246879:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246886:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982872a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.246899:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247051:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247057:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247062:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100433.247065:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247083:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247091:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926083e1be00) 00010000:00010000:0.0:1790100433.247093:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100433.247096:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247101:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982872aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247153:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828729c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e247 expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247166:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982872b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e247 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.247173:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:0.0:1790100433.247175:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100433.247177:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47e00, rc 0) 00000100:00100000:0.0:1790100433.247378:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+35:11338:x1877056127289344:12345-192.168.203.13@tcp:101:cat.0 Request processed in 968us (1203us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1790100433.247387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:2.0:1790100433.252972:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100433.253058:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127289600 00000100:00100000:3.0:1790100433.253068:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127289600 00000100:00100000:3.0:1790100433.253143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790100433.253153:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+35:11338:x1877056127289600:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:3.0:1790100433.253455:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+36:11338:x1877056127289600:12345-192.168.203.13@tcp:35:cat.0 Request processed in 303us (490us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1790100433.253463:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790100433.270105:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.270533:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127289856 00000100:00100000:2.0:1790100433.270543:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127289856 00000100:00100000:2.0:1790100433.270607:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:2.0:1790100433.270617:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+36:11340:x1877056127289856:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1790100433.270686:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1790100433.270713:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828724f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e232 expref: 36 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270735:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f22982872b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e247 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270746:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287287 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e240 expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270757:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e22b expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270766:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:2.0:1790100433.270784:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100433.270806:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270818:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270828:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270842:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270848:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270854:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270934:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270943:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.270949:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100433.271171:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1790100433.271181:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 284558841119ns, next at 285558838908ns, rc = 0 00010000:00010000:2.0:1790100433.271223:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271242:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271250:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271268:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271275:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271281:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271441:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100433.271461:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271467:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271473:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271478:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.271482:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271489:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271507:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:2.0:1790100433.271510:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790100433.271514:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271521:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271536:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271543:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271548:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271553:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.271556:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271562:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271570:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100433.271572:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.271574:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271580:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100433.271598:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fda45776 reply state 00000000b217c029 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271608:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.271614:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926183194c00) 00010000:00010000:2.0:1790100433.271616:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100433.271618:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100433.271687:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+34:11340:x1877056127289856:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1070us (1591us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1790100433.271695:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00010000:00010000:3.0:1790100433.275619:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100433.275634:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.275646:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100433.275650:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.275661:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.275772:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:3.0:1790100433.275776:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790100433.275781:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.275788:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982872d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.275822:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100433.275824:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100433.275826:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100433.320189:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.320306:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127290112 00000100:00100000:2.0:1790100433.320319:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127290112 00000100:00100000:2.0:1790100433.320420:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:2.0:1790100433.320430:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+34:11346:x1877056127290112:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100433.320455:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.320477:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e24e expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.320575:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.320590:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.320601:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.320631:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.320638:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.320644:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100433.320962:0:9338:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1790100433.321083:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321092:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321100:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321128:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321146:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321153:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321160:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.321163:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321181:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321192:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100433.321195:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.321200:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321206:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982872e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100433.321218:0:9338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005065012d reply state 0000000094bd9ad3 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321228:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321235:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926183194c00) 00010000:00010000:2.0:1790100433.321237:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100433.321239:0:9338:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790100433.321265:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982872db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 37 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321279:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 36 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.321286:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100433.321288:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100433.321290:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927400, rc 0) 00000100:00100000:2.0:1790100433.321382:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+37:11346:x1877056127290112:12345-192.168.203.13@tcp:101:bash.0 Request processed in 954us (1202us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1790100433.321395:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:2.0:1790100433.327252:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100433.327367:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127290240 00000100:00100000:1.0:1790100433.327376:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127290240 00000100:00100000:1.0:1790100433.327444:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1790100433.327453:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2420:x1877056127290240:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790100433.327470:0:10090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100433.327490:0:10090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e255 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100433.327512:0:10090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100433.327532:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1790100433.327536:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100433.327545:0:10090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 8 pid: 10090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.327564:0:10090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 8 pid: 10090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.327606:0:10090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e200, rc 0) 00000100:00100000:1.0:1790100433.327671:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2420:x1877056127290240:12345-192.168.203.13@tcp:101:bash.0 Request processed in 218us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100433.327685:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00080000:2.0:1790100433.328548:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100433.331566:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.331672:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127290368 00000100:00100000:2.0:1790100433.331689:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127290368 00000100:00100000:2.0:1790100433.331753:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1790100433.331764:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:11346:x1877056127290368:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100433.331782:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.331799:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e25c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.331830:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 9 pid: 10090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.331840:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100433.331844:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100433.331849:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.331884:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 9 pid: 10090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.331898:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 9 pid: 10090 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.331912:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8425:1877056140982784:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100433.332029:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100433.335963:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8425:1877056140982784:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100433.335997:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.336018:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927000, rc 0) 00000100:00100000:2.0:1790100433.336081:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:11346:x1877056127290368:12345-192.168.203.13@tcp:101:bash.0 Request processed in 4310us (4514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.336091:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1790100433.340578:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.340889:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127290496 00000100:00100000:2.0:1790100433.340899:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127290496 00010000:00010000:2.0:1790100433.341001:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 9 pid: 10090 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.341091:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1790100433.341101:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2422:x1877056127290496:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100433.341117:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100433.341148:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 9 pid: 10090 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.341161:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 9 pid: 10090 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.341186:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb000fc0/0xc87a4f22982872fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e255 expref: 9 pid: 10090 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.341221:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100433.341225:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100433.341234:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.341244:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.341285:0:9513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.341300:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9513:1877056140982912:192.168.203.13@tcp:105: 00000100:00100000:2.0:1790100433.341422:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100433.344839:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9513:1877056140982912:192.168.203.13@tcp:105: 00010000:00010000:2.0:1790100433.344864:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100433.344920:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127290496:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 3820us (4352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.344931:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1790100433.347154:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.347495:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127290752 00000100:00100000:0.0:1790100433.347506:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127290752 00000100:00100000:0.0:1790100433.347604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1790100433.347615:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+37:11346:x1877056127290752:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1790100433.347949:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+38:11346:x1877056127290752:12345-192.168.203.13@tcp:35:bash.0 Request processed in 335us (800us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1790100433.347956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1790100433.453998:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.454227:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127290880 00000100:00100000:0.0:1790100433.454236:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127290880 00000100:00100000:0.0:1790100433.454300:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:0.0:1790100433.454310:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+38:11362:x1877056127290880:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100433.454333:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100433.454394:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f229828730c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e263 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.454478:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287313 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.454494:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.454507:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100433.454549:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1790100433.454553:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100433.454569:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.454605:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f229828730c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e263 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.454622:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287313 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e263 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.454637:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:0.0:1790100433.454640:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100433.454643:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47a00, rc 0) 00000100:00100000:0.0:1790100433.454705:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+39:11362:x1877056127290880:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 396us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.454712:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:3.0:1790100433.458627:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.458755:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127291136 00000100:00100000:0.0:1790100433.458763:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127291136 00000100:00100000:0.0:1790100433.458847:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:0.0:1790100433.458854:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+39:11362:x1877056127291136:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100433.458871:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100433.458885:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828731a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e26a expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.458982:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287321 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.458996:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287321 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.459007:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287321 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100433.459017:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790100433.459127:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f229828731a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e26a expref: 42 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.459175:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287321 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e26a expref: 41 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.459183:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100433.459186:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100433.459189:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46a00, rc 0) 00000100:00100000:0.0:1790100433.459244:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+41:11362:x1877056127291136:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 389us (626us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1790100433.459250:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:3.0:1790100433.462511:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100433.462549:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.462573:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127291264 00000100:00100000:2.0:1790100433.462583:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127291264 00000100:00100000:0.0:1790100433.462682:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127291520 00000100:00100000:0.0:1790100433.462687:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127291520 00000100:00100000:0.0:1790100433.463019:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:2.0:1790100433.463021:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790100433.463029:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+42:2421:x1877056127291264:12345-192.168.203.13@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790100433.463029:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+42:11362:x1877056127291520:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100433.463044:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100433.463048:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100433.463062:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f229828732f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e271 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.463064:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287321 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e26a expref: 42 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.463091:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100433.463095:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100433.463168:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.463181:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.463192:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100433.463202:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790100433.463301:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f229828732f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e271 expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.463317:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287336 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e271 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.463323:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100433.463326:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790100433.463328:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46800, rc 0) 00000100:00100000:2.0:1790100433.464562:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+43:2421:x1877056127291264:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1528us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.464573:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1790100433.464744:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+42:11362:x1877056127291520:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1716us (2193us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1790100433.464752:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1790100433.471617:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100433.471698:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127291648 00000100:00100000:1.0:1790100433.471708:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127291648 00000100:00100000:1.0:1790100433.471761:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1790100433.471771:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2419:x1877056127291648:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1790100433.471814:0:10090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.471836:0:10090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.471845:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100433.471849:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100433.471853:0:10090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.471886:0:10090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.471901:0:10090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 8 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100433.471934:0:10090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926191239180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10090:1877056140983040:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100433.472033:0:10090:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100433.474102:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100433.474260:0:10090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926191239180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10090:1877056140983040:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100433.474286:0:10090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.474666:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127291776 00000100:00100000:0.0:1790100433.474674:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127291776 00002000:00100000:0.0:1790100433.474717:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9260831ba300 x1877056127291776/t0(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:729/0 lens 504/0 e 0 to 0 dl 1790100444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790100433.474727:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9260831ba300 with x1877056127291776 ext(0->8) 00010000:00010000:0.0:1790100433.474734:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 9 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.474748:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 9 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100433.474756:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9260831ba300 00000100:00100000:0.0:1790100433.474818:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1790100433.474827:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2422:x1877056127291776:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:0.0:1790100433.475541:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2422:x1877056127291776:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 712us (1444us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790100433.475555:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00100000:0.0:1790100433.475563:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9260831ba300 x1877056127291776/t4294967303(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:729/0 lens 504/448 e 0 to 0 dl 1790100444 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790100433.475572:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9260831ba300 with x1877056127291776 ext(0->8) 00010000:00010000:0.0:1790100433.475578:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 11 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.475590:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 11 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100433.475597:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9260831ba300 00000100:00100000:0.0:1790100433.478274:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100433.478504:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127291904 00000100:00100000:3.0:1790100433.478514:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127291904 00010000:00010000:3.0:1790100433.478551:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 11 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100433.478592:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1790100433.478602:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184254050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2419:x1877056127291904:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100433.478615:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790100433.478630:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790100433.478633:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790100432 00002000:00010000:3.0:1790100433.478635:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790100432 00002000:00010000:3.0:1790100433.478637:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1790100432 00002000:00010000:3.0:1790100433.478639:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1790100433.478646:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 11 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.478672:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 11 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.478704:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d431a37/0xc87a4f2298287305 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e25c expref: 11 pid: 8425 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.478720:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100433.478724:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100433.478729:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.478739:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.478774:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100433.478832:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184254050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2419:x1877056127291904:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 231us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100433.478839:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00010000:00010000:1.0:1790100433.479335:0:10090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.479641:0:10090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.479664:0:10090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.479673:0:10090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.479690:0:10090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.479698:0:10090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100433.479702:0:10090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.479724:0:10090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.479738:0:10090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.479747:0:10090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee0381d5/0xc87a4f2298287344 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100433.479807:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2419:x1877056127291648:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 8037us (8199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100433.479815:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1790100433.482418:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.482686:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127292160 00000100:00100000:2.0:1790100433.482695:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127292160 00000100:00100000:2.0:1790100433.482749:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1790100433.482759:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+42:11362:x1877056127292160:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:2.0:1790100433.482817:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287336 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e271 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100433.483031:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1790100433.483065:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1790100433.483663:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1790100433.483699:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.483714:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 46 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.483723:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.483755:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 46 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.483782:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 46 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.483797:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1877056140983168:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100433.483866:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100433.488715:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100433.488862:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127292288 00000100:00100000:1.0:1790100433.488872:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127292288 00010000:00010000:1.0:1790100433.488919:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 47 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100433.488963:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1790100433.488973:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+47:2421:x1877056127292288:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100433.488988:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100433.488995:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 47 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.489008:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 47 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.489047:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100433.489052:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.489062:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.489069:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.489098:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100433.489165:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+47:2421:x1877056127292288:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 192us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100433.489172:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00010000:00010000:2.0:1790100433.489557:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982872f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e24e expref: 46 pid: 9338 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.489573:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1877056140983168:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100433.489593:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.489601:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.489606:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100433.489703:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1790100433.489810:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1790100433.489890:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877056140983296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790100433.489934:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100433.489964:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100433.490207:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140983296 00000100:00100000:0.0:1790100433.490213:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140983296 00000100:00100000:0.0:1790100433.490272:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790100433.490282:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6515:x1877056140983296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790100433.490410:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6515:x1877056140983296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 129us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.490417:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790100433.490424:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877056140983296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790100433.490524:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1790100433.490564:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877056140983424:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1790100433.490581:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100433.490605:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100433.490626:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261862f99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100433.490818:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140983424 00000100:00100000:0.0:1790100433.490823:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140983424 00000100:00100000:0.0:1790100433.490850:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790100433.490857:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1877056140983424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790100433.491053:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6515:x1877056140983424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 196us (446us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790100433.491081:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790100433.491512:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877056140983424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790100433.491763:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1790100433.491800:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.491809:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.491815:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.491821:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100433.491825:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.491832:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.491846:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194f00) 00010000:00010000:3.0:1790100433.491848:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790100433.491852:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.491858:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828734b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100433.491948:0:6515:0:(mdd_object.c:4178:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790100433.492002:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1790100433.492013:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284779673664ns, next at 285779671487ns, rc = 0 00000001:00080000:3.0:1790100433.492019:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1790100433.492041:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194f00) 00010000:00010000:3.0:1790100433.492044:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790100433.492056:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287336 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e271 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100433.492274:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+49:11362:x1877056127292160:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 9515us (9862us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1790100433.492282:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000020:00080000:3.0:1790100433.492286:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790100433.495017:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.495094:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127292416 00000100:00100000:2.0:1790100433.495102:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127292416 00000100:00100000:2.0:1790100433.495169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:2.0:1790100433.495192:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+49:11362:x1877056127292416:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100433.495216:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.495236:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287352 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e278 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.495288:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287352 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e278 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.495303:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287352 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e278 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.495321:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100433.495323:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100433.495327:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926800, rc 0) 00000100:00100000:2.0:1790100433.495425:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+50:11362:x1877056127292416:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 234us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.495432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:0.0:1790100433.499062:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100433.499197:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127292672 00000100:00100000:3.0:1790100433.499207:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127292672 00000100:00100000:3.0:1790100433.499259:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1790100433.499266:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+50:11362:x1877056127292672:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790100433.499497:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+51:11362:x1877056127292672:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 230us (443us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790100433.499502:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1790100433.543055:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.543620:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127292800 00000100:00100000:2.0:1790100433.543630:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127292800 00000100:00100000:2.0:1790100433.543696:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:2.0:1790100433.543706:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+51:11372:x1877056127292800:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1790100433.543778:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.543795:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.543806:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.543830:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.543836:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.543979:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544043:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544051:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544057:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100433.544101:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544113:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544120:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544128:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544143:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.544147:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544160:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544172:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100433.544176:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.544180:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544187:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f2298287359 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544199:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544205:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544210:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544215:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.544218:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544223:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544229:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926183194c00) 00010000:00010000:2.0:1790100433.544231:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.544234:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544250:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287360 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544322:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544330:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544539:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544547:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.544550:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544557:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544565:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100433.544567:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.544570:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.544575:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287367 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.544653:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+51:11372:x1877056127292800:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 946us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.544661:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:0.0:1790100433.567816:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.568063:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127293056 00000100:00100000:2.0:1790100433.568084:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127293056 00000100:00100000:2.0:1790100433.568154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1790100433.568165:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+51:11375:x1877056127293056:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100433.568186:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.568207:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828736e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e27f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568286:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568312:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568323:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568335:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568613:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568621:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568725:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568735:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.568759:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100433.568770:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790100433.569472:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569482:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569489:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569496:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.569500:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569507:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569520:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100433.569523:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.569528:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569534:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287375 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569547:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569552:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569565:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569571:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.569574:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.569581:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.571515:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926183194c00) 00010000:00010000:2.0:1790100433.571519:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.571526:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.571534:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f229828737c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.571604:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828736e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.571619:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.571626:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100433.571628:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100433.571631:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927600, rc 0) 00000100:00100000:2.0:1790100433.571714:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+53:11375:x1877056127293056:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 3549us (3914us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790100433.571740:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:0.0:1790100433.574446:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.574589:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127293184 00000100:00100000:2.0:1790100433.574598:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127293184 00000100:00100000:2.0:1790100433.574646:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:2.0:1790100433.574655:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+53:11375:x1877056127293184:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790100433.574724:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574740:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574751:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574785:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574793:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574799:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574817:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.574822:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574829:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574849:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100433.574864:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100433.574871:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.574878:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287391 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.574939:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+53:11375:x1877056127293184:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 285us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.574948:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1790100433.580782:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100433.581743:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127293440 00000100:00100000:3.0:1790100433.581753:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127293440 00000100:00100000:3.0:1790100433.581878:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1790100433.581887:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+53:11375:x1877056127293440:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790100433.582285:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+54:11375:x1877056127293440:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 396us (1509us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1790100433.582294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1790100433.670973:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.671320:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127293696 00000100:00100000:2.0:1790100433.671331:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127293696 00000100:00100000:2.0:1790100433.671426:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:2.0:1790100433.671437:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+54:11385:x1877056127293696:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100433.671459:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.671462:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790100433.671486:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287313 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e263 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.671504:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100433.671509:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100433.671522:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287398 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e286 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.671620:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.671634:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.671659:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.671692:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.671705:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 54 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.671717:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140983552:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100433.671827:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100433.678648:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140983552:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100433.678690:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100433.679740:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.679944:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127293824 00000100:00100000:0.0:1790100433.679952:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127293824 00010000:00010000:0.0:1790100433.679994:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 55 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.680037:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:0.0:1790100433.680047:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+55:2421:x1877056127293824:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100433.680061:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100433.680079:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 55 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.680092:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 55 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.680111:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287383 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e27f expref: 55 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.680127:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:0.0:1790100433.680144:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.680166:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.680173:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.680202:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100433.680259:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+54:2421:x1877056127293824:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 213us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.680267:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00010000:00010000:3.0:1790100433.680767:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.680788:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100433.680806:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790100433.680926:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287398 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 55 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.680942:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 54 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100433.680950:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:3.0:1790100433.680953:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100433.680955:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927800, rc 0) 00000100:00100000:3.0:1790100433.680991:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+54:11385:x1877056127293696:12345-192.168.203.13@tcp:101:bash.0 Request processed in 9556us (10027us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1790100433.681003:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1790100433.684438:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.685267:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127293952 00000100:00100000:2.0:1790100433.685279:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127293952 00000100:00100000:2.0:1790100433.685375:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:2.0:1790100433.685386:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+54:11385:x1877056127293952:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100433.685411:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.685429:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982873ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e28d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.685463:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.685476:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.685501:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.685609:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982873ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.685627:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.685635:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100433.685638:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100433.685641:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926a00, rc 0) 00000100:00100000:2.0:1790100433.685706:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+55:11385:x1877056127293952:12345-192.168.203.13@tcp:101:bash.0 Request processed in 321us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.685713:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:0.0:1790100433.695096:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100433.695197:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127294208 00000100:00100000:1.0:1790100433.695207:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127294208 00000100:00100000:1.0:1790100433.695280:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1790100433.695292:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+55:11385:x1877056127294208:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:1.0:1790100433.695792:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.695809:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.695821:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100433.695863:0:6512:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1790100433.695886:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000219bb833 reply state 000000006446dda1 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.695914:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.695921:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100433.695924:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100433.695928:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790100433.696028:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+58:11385:x1877056127294208:12345-192.168.203.13@tcp:36:bash.0 Request processed in 737us (938us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1790100433.696036:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000020:00080000:1.0:1790100433.696041:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790100433.704445:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.704591:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127294336 00000100:00100000:2.0:1790100433.704601:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127294336 00000100:00100000:2.0:1790100433.704655:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:2.0:1790100433.704663:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+58:11385:x1877056127294336:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100433.704687:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.704704:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982873c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e294 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.704805:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.704820:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 59 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.704834:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.704864:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 59 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.704877:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 59 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.704890:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140983680:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100433.704978:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100433.712177:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.712618:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140983680:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100433.712645:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100433.713703:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127294464 00000100:00100000:1.0:1790100433.713714:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127294464 00010000:00010000:1.0:1790100433.713759:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 60 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100433.713800:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:1.0:1790100433.713809:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+60:2421:x1877056127294464:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100433.713824:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100433.713831:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 60 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.713844:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 60 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.713867:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828739f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e286 expref: 60 pid: 12139 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.714009:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100433.714016:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.714027:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.714033:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.714062:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100433.714166:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.714175:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100433.714225:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790100433.714230:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100433.714250:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.714465:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982873c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 60 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.714494:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 59 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.714502:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100433.714506:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100433.714508:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927000, rc 0) 00000100:00100000:2.0:1790100433.714574:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11385:x1877056127294336:12345-192.168.203.13@tcp:101:bash.0 Request processed in 9911us (10137us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.714583:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1790100433.715616:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+58:2421:x1877056127294464:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1804us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100433.715626:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:3.0:1790100433.718195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100433.718326:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127294720 00000100:00100000:1.0:1790100433.718336:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127294720 00000100:00100000:1.0:1790100433.718415:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1790100433.718424:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+58:11385:x1877056127294720:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1790100433.718606:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11385:x1877056127294720:12345-192.168.203.13@tcp:35:bash.0 Request processed in 182us (419us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1790100433.718613:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00010000:00010000:2.0:1790100433.736593:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100433.805665:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100433.805734:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127294848 00000100:00100000:1.0:1790100433.805744:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127294848 00000100:00100000:1.0:1790100433.805806:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:1.0:1790100433.805816:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+59:11391:x1877056127294848:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100433.805839:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100433.805871:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f22982873d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e29b expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.805935:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982873d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.805950:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982873d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.805962:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982873d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100433.806004:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1790100433.806008:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100433.806025:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982873d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.806046:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f22982873d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e29b expref: 61 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.806064:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982873d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e29b expref: 60 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.806072:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100433.806075:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100433.806079:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f600, rc 0) 00000100:00100000:1.0:1790100433.806145:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11391:x1877056127294848:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 330us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100433.806153:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1790100433.809385:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.809469:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127294976 00000100:00100000:2.0:1790100433.809478:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127294976 00000100:00100000:2.0:1790100433.809537:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:2.0:1790100433.809548:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11391:x1877056127294976:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100433.809568:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100433.809586:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982873de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2a2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809646:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809660:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809683:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809714:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809722:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809729:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809815:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f22982873f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809824:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f22982873f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809830:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f22982873f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100433.809869:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790100433.809874:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100433.809889:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f22982873f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809913:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f22982873f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809922:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809928:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809943:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809949:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.809952:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809959:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809970:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100433.809973:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.809976:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809982:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982873e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.809995:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810000:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810005:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810009:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100433.810011:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810025:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810032:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926183194c00) 00010000:00010000:2.0:1790100433.810034:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100433.810036:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810042:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982873ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810079:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982873de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a2 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810093:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f22982873f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a2 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.810099:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100433.810101:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100433.810103:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927800, rc 0) 00000100:00100000:2.0:1790100433.812510:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11391:x1877056127294976:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2954us (3124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100433.812525:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:3.0:1790100433.815999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100433.816084:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.816186:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127295360 00000100:00100000:0.0:1790100433.816195:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127295360 00000100:00100000:0.0:1790100433.816395:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1790100433.816396:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127295232 00000100:00100000:2.0:1790100433.816400:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127295232 00000100:00100000:2.0:1790100433.816431:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:2.0:1790100433.816438:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+62:11391:x1877056127295232:12345-192.168.203.13@tcp:101:lfs.0 00000100:00100000:0.0:1790100433.816464:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+62:2421:x1877056127295360:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100433.816469:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100433.816475:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100433.816488:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982873fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2a9 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.816495:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f22982873f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a2 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.816540:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:0.0:1790100433.816545:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100433.816582:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.816595:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 62 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.816603:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.816603:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+62:2421:x1877056127295360:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 200us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.816611:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:2.0:1790100433.816632:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 61 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.816643:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 61 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100433.816656:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140983808:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100433.817043:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100433.820979:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.821084:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140983808:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100433.821110:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.821168:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127295488 00000100:00100000:0.0:1790100433.821175:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127295488 00010000:00010000:0.0:1790100433.821208:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 62 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.821269:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1790100433.821279:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+62:2421:x1877056127295488:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100433.821293:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100433.821310:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 62 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.821322:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 62 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.821524:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982873c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e294 expref: 62 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.821541:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:0.0:1790100433.821546:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.821555:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.821562:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.821602:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100433.821632:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.821639:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100433.821647:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+61:2421:x1877056127295488:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 369us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.821655:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000004:00200000:2.0:1790100433.821664:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790100433.821836:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982873fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 62 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.821853:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 61 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100433.821861:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100433.821863:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790100433.821865:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927600, rc 0) 00000100:00100000:2.0:1790100433.822756:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11391:x1877056127295232:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 6314us (6761us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1790100433.822766:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1790100433.827634:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.827684:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127295744 00000100:00100000:0.0:1790100433.827703:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127295744 00000100:00100000:0.0:1790100433.827772:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790100433.827782:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11391:x1877056127295744:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:0.0:1790100433.827800:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100433.827822:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287352 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e278 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.827842:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:0.0:1790100433.827847:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100433.827908:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11391:x1877056127295744:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 127us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.827915:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790100433.829398:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100433.829513:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127295872 00000100:00100000:0.0:1790100433.829521:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127295872 00000100:00100000:0.0:1790100433.829610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1790100433.829620:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11391:x1877056127295872:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1790100433.829716:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.829733:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100433.829743:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100433.829827:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1790100433.829896:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11391:x1877056127295872:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 277us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100433.829903:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:3.0:1790100433.831504:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100433.834210:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127296000 00000100:00100000:2.0:1790100433.834224:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127296000 00000100:00100000:1.0:1790100433.834297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1790100433.834311:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+60:11391:x1877056127296000:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100433.834330:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100433.834365:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2b0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.834419:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.834431:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.834449:0:6512:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.834462:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.834475:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100433.834478:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100433.834483:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100433.834490:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8ec00, rc 0) 00000100:00100000:1.0:1790100433.834549:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11391:x1877056127296000:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 242us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100433.834557:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:3.0:1790100434.263378:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.263424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.263516:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127296128 00000100:00100000:0.0:1790100434.263525:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127296128 00000100:00100000:0.0:1790100434.263584:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 364 00000100:00100000:0.0:1790100434.263593:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127296128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100434.263654:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127296128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 62us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.263661:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 364 00000100:00100000:3.0:1790100434.267294:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.267335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.267450:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100434.267514:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127296640 00000100:00100000:1.0:1790100434.267528:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127296640 00000100:00100000:0.0:1790100434.267542:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127296256 00000100:00100000:0.0:1790100434.267546:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127296256 00000100:00100000:1.0:1790100434.267595:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:1.0:1790100434.267604:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127296640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100434.267670:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127296640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100434.267678:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:1.0:1790100434.267694:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:1.0:1790100434.267700:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127296256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100434.267726:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127296256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100434.267732:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:2.0:1790100434.278390:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127296384 00000100:00100000:2.0:1790100434.278404:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127296384 00000100:00100000:2.0:1790100434.278464:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127296512 00000100:00100000:2.0:1790100434.278468:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127296512 00000100:00100000:2.0:1790100434.278616:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:2.0:1790100434.278627:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127296384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100434.278695:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127296384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (15270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.278702:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:2.0:1790100434.278721:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1790100434.278727:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2421:x1877056127296512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100434.278773:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2421:x1877056127296512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (11321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.278780:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00080000:3.0:1790100434.278877:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790100434.278883:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100434.279211:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.280657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127296768 00000100:00100000:3.0:1790100434.280666:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127296768 00000100:00100000:3.0:1790100434.280736:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:3.0:1790100434.280744:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127296768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100434.280806:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2421:x1877056127296768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 62us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100434.280813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00080000:2.0:1790100434.284204:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1790100434.376659:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100434.376669:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100434.376714:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1790100434.376723:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100434.376847:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140983936:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790100434.376941:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8180 going to sleep for 11 seconds 00000100:00100000:3.0:1790100434.388006:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140983936:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790100434.391620:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.391926:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127296896 00000100:00100000:0.0:1790100434.391937:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127296896 00000100:00100000:0.0:1790100434.391998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1790100434.392008:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11392:x1877056127296896:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790100434.392039:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790100434.392160:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11392:x1877056127296896:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 153us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.392169:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1790100434.402251:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.405307:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127297024 00000100:00100000:3.0:1790100434.405322:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127297024 00000100:00100000:3.0:1790100434.405399:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:3.0:1790100434.405415:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11392:x1877056127297024:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790100434.408540:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408563:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408575:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408591:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408596:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408600:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408622:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408639:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408643:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100434.408699:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790100434.408704:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100434.408716:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408732:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408738:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408745:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408760:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100434.408764:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408771:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408783:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:2.0:1790100434.408786:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100434.408791:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408807:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828741d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408820:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408826:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408832:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408837:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100434.408840:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408847:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408854:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff926183194e00) 00010000:00010000:2.0:1790100434.408857:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100434.408860:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408865:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287424 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408879:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408885:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408896:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408902:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100434.408911:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408916:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408924:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100434.408927:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100434.408930:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.408936:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828742b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.412299:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11392:x1877056127297024:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 6880us (10046us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.412314:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:2.0:1790100434.422262:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100434.423645:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127297280 00000100:00100000:1.0:1790100434.423656:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127297280 00000100:00100000:1.0:1790100434.423721:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:1.0:1790100434.423731:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+61:11392:x1877056127297280:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100434.423761:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100434.423782:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287432 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2b7 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.423896:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.423910:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.423921:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100434.423942:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790100434.424013:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424021:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424028:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424034:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100434.424037:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424044:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424055:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100434.424058:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100434.424062:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424069:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424107:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287432 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b7 expref: 63 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424116:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:1.0:1790100434.424119:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100434.424140:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287432 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b7 expref: 63 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.424150:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8ee00, rc 0) 00000100:00100000:1.0:1790100434.424407:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+62:11392:x1877056127297280:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 676us (2153us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1790100434.424414:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:1.0:1790100434.434607:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.434729:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127297408 00000100:00100000:3.0:1790100434.434741:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127297408 00000100:00100000:3.0:1790100434.434806:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:3.0:1790100434.434817:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+62:11392:x1877056127297408:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100434.434852:0:9338:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100434.434966:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+62:11392:x1877056127297408:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 151us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100434.434985:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:1.0:1790100434.439524:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.439620:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127297664 00000100:00100000:2.0:1790100434.439630:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127297664 00000100:00100000:2.0:1790100434.439686:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1790100434.439696:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+62:11392:x1877056127297664:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100434.439716:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100434.439719:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790100434.439743:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982873d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e29b expref: 62 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.439775:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100434.439780:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100434.439792:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287447 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100434.440112:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1790100434.440243:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828744e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.440255:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828744e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.440265:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828744e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.440308:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287447 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2be expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.440321:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828744e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2be expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.440328:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926183194e00) 00010000:00010000:2.0:1790100434.440330:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100434.440333:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926600, rc 0) 00000100:00100000:2.0:1790100434.440446:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+63:11392:x1877056127297664:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 752us (931us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1790100434.440453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1790100434.444637:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100434.444717:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127297920 00000100:00100000:1.0:1790100434.444727:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127297920 00000100:00100000:1.0:1790100434.444796:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:1.0:1790100434.444806:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+63:11392:x1877056127297920:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790100434.444856:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100434.444880:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828744e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2be expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.444898:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926183194e00) 00010000:00010000:1.0:1790100434.444909:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100434.444928:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.444942:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.444951:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.444964:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.444983:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.444990:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445033:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445041:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445047:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445053:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100434.445057:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445064:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445073:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100434.445076:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100434.445080:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445086:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828745c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445096:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445108:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445114:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445119:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ee00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100434.445122:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445137:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445145:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x75a7d54e (ffff92619461fe00) 00010000:00010000:1.0:1790100434.445147:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100434.445150:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.445155:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287463 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x75a7d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100434.447768:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+62:11392:x1877056127297920:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 2943us (3120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100434.447780:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:1.0:1790100434.452919:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.452998:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127298048 00000100:00100000:0.0:1790100434.453008:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127298048 00000100:00100000:0.0:1790100434.453073:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:0.0:1790100434.453083:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+62:11392:x1877056127298048:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100434.453102:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100434.453135:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828746a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.453169:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.453193:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.453204:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.453303:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828746a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.453321:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.453331:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:0.0:1790100434.453334:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790100434.453389:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47600, rc 0) 00000100:00100000:0.0:1790100434.453474:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+63:11392:x1877056127298048:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 391us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.453481:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:2.0:1790100434.455385:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.455554:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127298304 00000100:00100000:0.0:1790100434.455562:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127298304 00000100:00100000:0.0:1790100434.455615:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:0.0:1790100434.455623:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+63:11392:x1877056127298304:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100434.455687:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.455702:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.455727:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100434.455874:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1790100434.455883:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 285743543232ns, next at 286743541283ns, rc = 0 00000004:00010000:0.0:1790100434.455920:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000053e693 reply state 000000009e9cb6ef transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.455932:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.455940:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:0.0:1790100434.455942:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790100434.455946:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100434.456021:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+65:11392:x1877056127298304:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 397us (642us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1790100434.456028:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:1.0:1790100434.462192:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.462389:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127298432 00000100:00100000:2.0:1790100434.462399:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127298432 00000100:00100000:2.0:1790100434.462456:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1790100434.462467:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+65:11392:x1877056127298432:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100434.462490:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100434.462508:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2cc expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.462563:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 66 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.462587:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 66 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.462603:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:2.0:1790100434.462607:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100434.462611:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927200, rc 0) 00000100:00100000:2.0:1790100434.462665:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+66:11392:x1877056127298432:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 200us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.462672:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:1.0:1790100434.467823:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.467905:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127298560 00000100:00100000:3.0:1790100434.467914:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127298560 00000100:00100000:3.0:1790100434.467970:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1790100434.467980:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2420:x1877056127298560:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790100434.468197:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2420:x1877056127298560:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 219us (382us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790100434.468205:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1790100434.476523:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.476663:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127298816 00000100:00100000:3.0:1790100434.476674:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127298816 00000100:00100000:3.0:1790100434.476729:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1790100434.476739:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+66:11392:x1877056127298816:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100434.477104:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+67:11392:x1877056127298816:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 364us (587us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1790100434.477112:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1790100434.484908:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.485017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127299072 00000100:00100000:2.0:1790100434.485027:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127299072 00000100:00100000:2.0:1790100434.485088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:2.0:1790100434.485098:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+67:11392:x1877056127299072:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100434.485215:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+67:11392:x1877056127299072:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.485229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:1.0:1790100434.496436:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.496603:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127299200 00000100:00100000:3.0:1790100434.496613:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127299200 00000100:00100000:3.0:1790100434.496665:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:3.0:1790100434.496683:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+67:11392:x1877056127299200:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100434.496702:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100434.496719:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287486 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2d3 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.496904:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828748d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.496933:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.496944:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100434.496981:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100434.496997:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.497021:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287486 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2d3 expref: 69 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.497039:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828748d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2d3 expref: 68 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.497048:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:3.0:1790100434.497051:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790100434.497054:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031800, rc 0) 00000100:00100000:3.0:1790100434.497113:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+68:11392:x1877056127299200:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 440us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100434.497119:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:3.0:1790100434.500722:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.501554:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127299328 00000100:00100000:2.0:1790100434.501565:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127299328 00000100:00100000:2.0:1790100434.501651:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1790100434.501662:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2421:x1877056127299328:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100434.501691:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100434.501711:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2da expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100434.501736:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c3d1, blocks: 0x0 00010000:00010000:2.0:1790100434.501755:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=285s v=(0 0) 00010000:00010000:2.0:1790100434.501760:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100434.501769:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 10 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.501786:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 10 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.501799:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927800, rc 0) 00000100:00100000:2.0:1790100434.501877:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2421:x1877056127299328:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 217us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.501885:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1790100434.504957:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.505156:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127299584 00000100:00100000:0.0:1790100434.505166:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127299584 00000100:00100000:0.0:1790100434.505225:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1790100434.505235:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+68:11392:x1877056127299584:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790100434.505333:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+68:11392:x1877056127299584:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.505364:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1790100434.506857:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.506917:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127299712 00000100:00100000:3.0:1790100434.506923:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127299712 00000100:00100000:3.0:1790100434.506983:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1790100434.506989:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+10:11392:x1877056127299712:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100434.507002:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100434.507026:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2e1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.507050:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 11 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.507059:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100434.507063:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100434.507068:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.507099:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 11 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.507110:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 11 pid: 8427 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100434.507120:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608481b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140984064:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100434.507210:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100434.514811:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608481b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140984064:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100434.514845:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100434.514848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:2.0:1790100434.514882:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030c00, rc 0) 00000100:00100000:2.0:1790100434.514943:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:11392:x1877056127299712:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 7951us (8088us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.514952:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1790100434.514991:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127299840 00000100:00100000:1.0:1790100434.515000:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127299840 00010000:00010000:1.0:1790100434.515034:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 11 pid: 8427 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100434.515067:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1790100434.515076:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184254450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2421:x1877056127299840:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100434.515089:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100434.515109:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 11 pid: 8427 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.515135:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 11 pid: 8427 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.515160:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000765e62ea/0xc87a4f2298287494 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2da expref: 11 pid: 8427 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.515174:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100434.515179:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100434.515186:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.515197:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.515243:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100434.515257:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926191238a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1877056140984192:192.168.203.13@tcp:105: 00000100:00100000:1.0:1790100434.515309:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100434.517555:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926191238a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1877056140984192:192.168.203.13@tcp:105: 00010000:00010000:0.0:1790100434.517579:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100434.517640:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184254450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2421:x1877056127299840:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2561us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.517650:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1790100434.518574:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.518683:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127299968 00000100:00100000:2.0:1790100434.518689:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127299968 00002000:00100000:2.0:1790100434.518734:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff926084811180 x1877056127299968/t0(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:730/0 lens 504/0 e 0 to 0 dl 1790100445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100434.518741:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926084811180 with x1877056127299968 ext(0->12) 00002000:00010000:2.0:1790100434.518745:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926084811180 00000100:00100000:2.0:1790100434.518769:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1790100434.518775:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2422:x1877056127299968:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790100434.519877:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+12:2422:x1877056127299968:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 1096us (1301us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790100434.519887:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:2.0:1790100434.519895:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff926084811180 x1877056127299968/t4294967309(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:730/0 lens 504/448 e 0 to 0 dl 1790100445 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100434.519904:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926084811180 with x1877056127299968 ext(0->12) 00002000:00010000:2.0:1790100434.519908:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926084811180 00000100:00100000:3.0:1790100434.521770:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.521853:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127300096 00000100:00100000:0.0:1790100434.521862:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127300096 00000100:00100000:0.0:1790100434.521912:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:0.0:1790100434.521921:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+68:11392:x1877056127300096:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790100434.523729:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1790100434.523741:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1790100434.523776:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1790100434.523798:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9261947be900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1790100434.523803:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083d8af00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9261947be300 00000020:00080000:1.0:1790100434.523807:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083d8a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff926082bdce00 00000004:00080000:1.0:1790100434.523834:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1790100434.523860:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9260839cd540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1790100434.523864:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92619405c500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9260839cd780 00000020:00080000:1.0:1790100434.523867:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92619405c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92608387a600 00000020:00080000:1.0:1790100434.523882:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1790100434.523902:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1790100434.523907:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:1.0:1790100434.523958:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790100434.524046:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140984320:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790100434.524093:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524105:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100434.524120:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524135:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100434.524140:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524149:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524164:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff926083e1b300) 00010000:00010000:0.0:1790100434.524168:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100434.524173:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524178:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140984448:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1790100434.524181:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982871a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524219:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100434.524225:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524233:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524239:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524244:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100434.524247:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524252:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1790100434.524254:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524262:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608481bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140984576:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790100434.524265:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92619461f900) 00010000:00010000:0.0:1790100434.524269:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100434.524273:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524278:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287248 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524291:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100434.524293:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524301:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524306:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524317:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100434.524321:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524326:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140984320 00010000:00010000:0.0:1790100434.524327:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524335:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140984320 00010000:00010000:0.0:1790100434.524376:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926183194c00) 00010000:00010000:0.0:1790100434.524379:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100434.524383:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524388:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982872c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524401:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524407:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524413:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524419:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926e00 already unused, calling callback (ffffffffc19dd4f0) 00000100:00100000:2.0:1790100434.524422:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140984448 00010000:00010000:0.0:1790100434.524423:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524428:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140984448 00010000:00010000:0.0:1790100434.524435:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524444:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140984576 00000100:00100000:2.0:1790100434.524449:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140984576 00010000:00010000:0.0:1790100434.524460:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926183194c00) 00000100:00100000:2.0:1790100434.524468:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1790100434.524469:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100434.524478:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524480:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1877056140984320:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790100434.524492:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982872e9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1790100434.524510:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1790100434.524511:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524520:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524526:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524531:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100434.524536:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524537:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524554:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524565:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100434.524566:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524569:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100434.524575:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.524583:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790100434.524584:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982873bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.524591:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100434.524597:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524620:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524628:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524633:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.524636:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524638:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100434.524642:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524656:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524665:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:2.0:1790100434.524668:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 11 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524668:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790100434.524670:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.524674:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287478 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.524699:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1980380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8426:1877056140984704:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100434.524761:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100434.524767:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+16:11392:x1877056127300096:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 2845us (3001us total) trans 0 rc 0/0 00000100:00080000:2.0:1790100434.524776:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100434.524778:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:2.0:1790100434.524794:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790100434.524803:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056140984448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790100434.524909:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790100434.524913:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790100433 00002000:00010000:2.0:1790100434.524915:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790100434.524930:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790100433 -> 1790100433 00002000:00010000:2.0:1790100434.524933:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1790100434.524970:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3641:x1877056140984448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (752us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790100434.524991:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1790100434.524995:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff926083c56a00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1790100434.525003:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140984448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790100434.525009:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790100434.525018:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3641:x1877056140984576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790100434.525031:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1790100434.525051:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6ab2c3d0, atime: 0x6ab2c3d0, ctime: 0x6ab2c3d0, blocks: 0x8 00010000:00010000:2.0:1790100434.525057:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.525066:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=285s v=(0 0) 00010000:00010000:2.0:1790100434.525070:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100434.525076:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.525102:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.525112:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.525120:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.525155:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790100434.525280:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3641:x1877056140984576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 263us (989us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790100434.525287:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1790100434.525615:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100434.525621:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.525642:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100434.525646:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.525654:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.525673:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.525681:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4acc5a/0xc87a4f22982874a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.525696:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100434.525698:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100434.525700:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790100434.525716:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92608481bb80/2, rc 0, transno 4294967305 00000100:00100000:0.0:1790100434.525722:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608481bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140984576:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1790100434.526571:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1790100434.526582:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1790100434.528619:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100434.528689:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.528983:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1980380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8426:1877056140984704:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100434.529008:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100434.529090:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127300352 00000100:00100000:0.0:1790100434.529098:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127300352 00010000:00010000:0.0:1790100434.529140:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 12 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100434.529175:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:0.0:1790100434.529185:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+12:2421:x1877056127300352:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100434.529199:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100434.529205:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 12 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529217:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 12 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529238:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287256 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e239 expref: 12 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529251:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100434.529255:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100434.529260:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529269:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529299:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100434.529373:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2421:x1877056127300352:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 189us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.529381:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00010000:00010000:2.0:1790100434.529438:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.529447:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.529456:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.529470:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.529494:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790100434.529637:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3643:x1877056140984320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5158us (5529us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790100434.529645:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790100434.529659:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127300224 00000100:00100000:2.0:1790100434.529662:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127300224 00010000:00010000:0.0:1790100434.529713:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100434.529719:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529727:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100434.529731:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529740:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529753:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529761:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f22982874a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.529777:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100434.529779:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100434.529780:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100434.529972:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000004:00080000:2.0:1790100434.530866:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9261c197e680/2, rc 0, transno 4294967311 00000100:00100000:2.0:1790100434.530873:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c197e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140984320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790100434.530894:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2422:x1877056127300224:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790100434.532506:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1790100434.532517:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1790100434.532657:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127300224:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 2675us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.532666:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1790100434.539557:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.539637:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127300608 00000100:00100000:2.0:1790100434.539646:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127300608 00000100:00100000:2.0:1790100434.539707:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:2.0:1790100434.539716:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+16:11392:x1877056127300608:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100434.539762:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100434.539785:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828748d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2d3 expref: 16 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.539803:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:2.0:1790100434.539818:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100434.539844:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.539855:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.539865:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100434.539970:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9773f07 reply state 00000000ce8e07e8 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.539982:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.539988:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:2.0:1790100434.539990:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100434.539992:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100434.540077:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+17:11392:x1877056127300608:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 362us (527us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1790100434.540084:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:0.0:1790100434.541729:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.541980:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127300736 00000100:00100000:2.0:1790100434.541987:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127300736 00000100:00100000:2.0:1790100434.542027:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1790100434.542034:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2419:x1877056127300736:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790100434.542244:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790100434.542248:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790100433 -> 1790100433 00002000:00010000:2.0:1790100434.542250:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790100432 00002000:00010000:2.0:1790100434.542252:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790100433 -> 1790100433 00002000:00010000:2.0:1790100434.542265:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790100434.542388:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127300736:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 352us (661us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790100434.542395:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1790100434.544319:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100434.544511:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127300992 00000100:00100000:1.0:1790100434.544528:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127300992 00000100:00100000:1.0:1790100434.544607:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:1.0:1790100434.544616:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+17:11392:x1877056127300992:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790100434.544682:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.544699:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.544708:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.544740:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.544754:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 17 pid: 6512 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100434.544767:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926191238700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140984832:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100434.544880:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100434.547620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.547696:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127301120 00000100:00100000:3.0:1790100434.547705:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127301120 00010000:00010000:3.0:1790100434.547742:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 18 pid: 6512 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100434.547779:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1790100434.547788:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2421:x1877056127301120:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100434.547811:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100434.547818:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 18 pid: 6512 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.547830:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 18 pid: 6512 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.547849:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:3.0:1790100434.547854:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.547862:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.547869:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.547883:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100434.547951:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2421:x1877056127301120:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 163us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100434.547958:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00010000:00010000:0.0:1790100434.549387:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287471 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2c5 expref: 17 pid: 6512 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100434.549422:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926191238700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140984832:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100434.549444:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549521:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549529:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549564:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549571:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549578:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549584:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100434.549588:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549596:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549607:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:2.0:1790100434.549610:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790100434.549614:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.549620:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982874b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.549775:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+16:11392:x1877056127300992:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 5159us (5460us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790100434.549784:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:1.0:1790100434.551924:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.551972:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127301248 00000100:00100000:2.0:1790100434.551981:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127301248 00000100:00100000:2.0:1790100434.552035:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1790100434.552045:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127301248:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790100434.552204:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.552223:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.552232:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100434.552236:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100434.552240:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.552272:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.552286:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 7 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.552300:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1980380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1877056140984960:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100434.552400:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790100434.554848:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.554923:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127301376 00000100:00100000:0.0:1790100434.554931:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127301376 00010000:00010000:0.0:1790100434.554968:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 8 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100434.555009:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1790100434.555019:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127301376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100434.555033:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100434.555053:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 8 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.555077:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 8 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.555101:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100434.555105:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100434.555111:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.555121:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.555165:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100434.555223:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127301376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 204us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.555230:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00010000:00010000:2.0:1790100434.556442:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084f917e0/0xc87a4f229828749b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e1 expref: 7 pid: 8425 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.556462:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1980380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1877056140984960:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100434.556483:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556494:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556501:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556525:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556533:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556541:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556548:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100434.556552:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556578:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556595:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.556602:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67553f3/0xc87a4f22982874be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.556719:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127301248:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 4675us (4801us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.556728:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1790100434.559054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.559145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127301632 00000100:00100000:0.0:1790100434.559153:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127301632 00000100:00100000:0.0:1790100434.559207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:0.0:1790100434.559216:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+16:11392:x1877056127301632:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790100434.559286:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.559301:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.559311:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.559375:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.559388:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 16 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100434.559401:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140985088:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100434.559469:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100434.561987:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140985088:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100434.562025:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100434.567481:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.567567:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127301760 00000100:00100000:3.0:1790100434.567577:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127301760 00010000:00010000:3.0:1790100434.567614:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 17 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100434.567656:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:3.0:1790100434.567666:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+17:2421:x1877056127301760:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100434.567703:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100434.567711:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 17 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.567724:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 17 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.567743:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982873b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e28d expref: 17 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.567758:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:3.0:1790100434.567764:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.567774:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.567781:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.567788:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.567819:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100434.567877:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+16:2421:x1877056127301760:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 212us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100434.567884:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00010000:00010000:0.0:1790100434.568052:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.568066:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.568218:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.568230:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 16 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.568238:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.568265:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 16 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.568278:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 16 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100434.568290:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140985216:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100434.568395:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100434.570861:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140985216:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100434.570887:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.575092:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100434.575195:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127301888 00000100:00100000:0.0:1790100434.575205:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127301888 00010000:00010000:0.0:1790100434.575246:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 17 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100434.575288:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1790100434.575297:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+17:2422:x1877056127301888:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100434.575311:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100434.575318:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 17 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.575330:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 17 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.575386:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828747f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2cc expref: 17 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.575402:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:0.0:1790100434.575407:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.575417:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.575425:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100434.575449:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100434.575521:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+16:2422:x1877056127301888:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 224us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.575529:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00010000:00010000:2.0:1790100434.575593:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.575602:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100434.575711:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1790100434.575822:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1790100434.575855:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1790100434.575923:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1877056140985344:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790100434.575961:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100434.575994:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100434.576270:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140985344 00000100:00100000:0.0:1790100434.576275:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140985344 00000100:00100000:0.0:1790100434.576310:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790100434.576317:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1877056140985344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790100434.576429:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1877056140985344:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100434.576434:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790100434.576497:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1790100434.576502:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1790100434.576520:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff926083c56a00, transno 4294967310 00000004:00080000:1.0:1790100434.576554:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9261c197e680, transno 4294967311 00000100:00100000:1.0:1790100434.576561:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1877056140985344:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790100434.576656:0:6513:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1790100434.576708:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1877056140985472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790100434.576735:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100434.576750:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff926184ed3000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100434.576845:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140985472 00000100:00100000:3.0:1790100434.576849:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140985472 00000100:00100000:3.0:1790100434.576886:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790100434.576894:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1877056140985472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790100434.576980:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6513:x1877056140985472:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (244us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790100434.576987:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790100434.577648:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1877056140985472:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1790100434.577690:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577700:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577706:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577712:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100434.577717:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577724:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577737:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:1.0:1790100434.577740:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100434.577745:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577751:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f22982874cc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577783:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577790:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577795:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577800:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100434.577803:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577809:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577817:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100434.577820:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100434.577826:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577836:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577846:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.577870:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100434.577892:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140985600:192.168.203.13@tcp:105: 00000100:00100000:1.0:1790100434.577953:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff92619448dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790100434.580963:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140985600:192.168.203.13@tcp:105: 00010000:00010000:1.0:1790100434.580991:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581001:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f229828740f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581031:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581042:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581052:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581069:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581076:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581083:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581088:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8fa00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100434.581092:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581111:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581135:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100434.581138:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100434.581143:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581149:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982874d3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581160:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581166:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581172:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581177:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100434.581180:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581186:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581193:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100434.581195:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100434.581198:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.581212:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982874c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100434.581431:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+19:11392:x1877056127301632:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 22214us (22382us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1790100434.581441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000020:00080000:1.0:1790100434.581447:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790100434.581705:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100434.581710:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100434.582648:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790100434.582657:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790100434.582970:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.583774:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127302016 00000100:00100000:2.0:1790100434.583782:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127302016 00000100:00100000:2.0:1790100434.583835:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1790100434.583845:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+19:11391:x1877056127302016:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:0.0:1790100434.584719:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.584884:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+19:11391:x1877056127302016:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 1039us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.584893:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1790100434.584974:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127302272 00000100:00100000:3.0:1790100434.584979:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127302272 00000100:00100000:3.0:1790100434.585004:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1790100434.585012:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+20:11392:x1877056127302272:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790100434.585244:0:6516:0:(mdd_object.c:4178:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790100434.585272:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1790100434.585302:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.585318:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.585328:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.586098:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.586109:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.586115:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100434.586325:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790100434.586403:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+21:11392:x1877056127302272:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1390us (1684us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1790100434.586411:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000020:00080000:1.0:1790100434.586414:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100434.586756:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100434.586762:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.586770:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100434.586774:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.586783:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.586796:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:2.0:1790100434.586799:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790100434.586802:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.586808:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982874da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.586819:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100434.586821:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100434.586828:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100434.588475:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.588545:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127302528 00000100:00100000:2.0:1790100434.588553:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127302528 00000100:00100000:2.0:1790100434.588605:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:2.0:1790100434.588615:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+21:11391:x1877056127302528:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:2.0:1790100434.588869:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1790100434.588954:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+21:11391:x1877056127302528:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 340us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.588961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:0.0:1790100434.604536:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.604593:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127302656 00000100:00100000:2.0:1790100434.604604:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127302656 00000100:00100000:2.0:1790100434.604675:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:2.0:1790100434.604686:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+21:11394:x1877056127302656:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100434.604708:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100434.604728:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982874e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2e8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604788:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604801:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604813:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604826:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604833:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604853:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604919:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604928:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 22 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604937:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604966:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 22 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.604979:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 22 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100434.604992:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140985728:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100434.605082:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100434.607437:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140985728:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100434.607464:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100434.608138:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100434.608318:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127302912 00000100:00100000:2.0:1790100434.608324:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127302912 00000100:00100000:2.0:1790100434.608388:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1790100434.608398:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+23:6182:x1877056127302912:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790100434.608615:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+24:6182:x1877056127302912:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 217us (489us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1790100434.608622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1790100434.621275:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100434.621379:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127303040 00000100:00100000:3.0:1790100434.621388:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127303040 00010000:00010000:3.0:1790100434.621432:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 24 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100434.621477:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:3.0:1790100434.621487:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+24:2421:x1877056127303040:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100434.621502:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100434.621509:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 24 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.621523:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 24 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.621545:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287401 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2a9 expref: 24 pid: 12139 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.621562:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:3.0:1790100434.621567:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.621577:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.621585:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100434.621617:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100434.621677:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+23:2421:x1877056127303040:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 190us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100434.621685:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00010000:00010000:2.0:1790100434.621754:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621764:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100434.621813:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790100434.621818:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100434.621836:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621849:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621858:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621864:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621870:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621876:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100434.621880:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621887:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621903:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:2.0:1790100434.621906:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100434.621910:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621916:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982874e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621927:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621932:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621938:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621943:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100434.621946:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621951:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621957:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff926183194100) 00010000:00010000:2.0:1790100434.621959:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100434.621962:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.621967:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.622011:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927400/0xc87a4f22982874e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.622024:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e8 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100434.622032:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100434.622034:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100434.622036:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926c00, rc 0) 00000100:00100000:2.0:1790100434.622075:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+22:11394:x1877056127302656:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 17391us (17549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.622082:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00010000:00010000:3.0:1790100434.761614:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790100435.382824:0:14296:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100435.382832:0:14296:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100435.382863:0:14296:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790100435.382870:0:14296:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100435.407212:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140985856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100435.407273:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100435.407331:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140985856 00000100:00100000:2.0:1790100435.407354:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140985856 00000100:00100000:2.0:1790100435.407390:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790100435.407397:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140985856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100435.407417:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1790100435.407456:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140985856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100435.407463:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790100435.407509:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140985856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100435.407837:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140985984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100435.407868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100435.408020:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140985984 00000100:00100000:0.0:1790100435.408025:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140985984 00000100:00100000:0.0:1790100435.408115:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790100435.408131:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140985984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100435.408143:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1790100435.408173:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140985984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100435.408188:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790100435.408219:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140985984:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790100435.408748:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1790100435.592563:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100435.592582:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100435.592608:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790100435.592616:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100435.592752:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140986112:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790100435.592858:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100435.596575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100435.596661:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127303168 00000100:00100000:1.0:1790100435.596669:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127303168 00000100:00100000:1.0:1790100435.596740:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:1.0:1790100435.596749:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+23:11407:x1877056127303168:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790100435.596780:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790100435.596874:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+23:11407:x1877056127303168:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 126us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100435.596881:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00080000:3.0:1790100435.596973:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100435.597152:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140986112:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790100435.599471:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100435.599554:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127303424 00000100:00100000:2.0:1790100435.599561:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127303424 00000100:00100000:2.0:1790100435.599879:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:2.0:1790100435.599890:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+22:11407:x1877056127303424:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100435.599907:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100435.599926:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.600017:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.600032:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.600043:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100435.600054:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790100435.600163:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f22982874fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2ef expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.600181:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2ef expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.600207:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100435.600209:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100435.600213:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927e00, rc 0) 00000100:00100000:2.0:1790100435.600267:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+24:11407:x1877056127303424:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 379us (802us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1790100435.600275:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:0.0:1790100435.603692:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100435.603731:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100435.603819:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127303680 00000100:00100000:2.0:1790100435.603835:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127303680 00000100:00100000:3.0:1790100435.603860:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127303808 00000100:00100000:3.0:1790100435.603866:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127303808 00000100:00100000:2.0:1790100435.603915:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:3.0:1790100435.603937:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1790100435.603947:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+25:2421:x1877056127303808:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100435.603961:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100435.603985:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287504 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2ef expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100435.603991:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+25:11407:x1877056127303680:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790100435.604011:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:3.0:1790100435.604016:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100435.604066:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+24:2421:x1877056127303808:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 121us (332us total) trans 0 rc 0/0 00010000:00010000:2.0:1790100435.604067:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100435.604081:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:2.0:1790100435.604089:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.604102:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.604329:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.604360:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.604368:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.604395:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100435.604400:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.604408:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.604418:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:2.0:1790100435.604422:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100435.604426:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100435.604433:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287512 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100435.604521:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+24:11407:x1877056127303680:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 597us (837us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1790100435.604529:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000040:00080000:0.0:1790100435.604617:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100435.604621:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100435.605820:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790100435.605830:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100435.607165:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100435.607223:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127304064 00000100:00100000:1.0:1790100435.607238:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127304064 00000100:00100000:1.0:1790100435.607319:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1790100435.607327:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+24:11407:x1877056127304064:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790100435.607819:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+25:11407:x1877056127304064:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 491us (658us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1790100435.607840:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00010000:00010000:0.0:1790100435.786667:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100435.915503:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140986240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100435.915569:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100435.915754:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140986240 00000100:00100000:2.0:1790100435.915772:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140986240 00000100:00100000:2.0:1790100435.915824:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790100435.915833:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140986240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100435.915864:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1790100435.916099:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140986240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 266us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100435.916107:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790100435.916177:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140986240:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790100436.810026:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100436.936683:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140986368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100436.936767:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100436.937130:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140986368 00000100:00100000:2.0:1790100436.937155:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140986368 00000100:00100000:2.0:1790100436.937287:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790100436.937297:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140986368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100436.937330:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100436.937400:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140986368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100436.937407:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790100436.937483:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140986368:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1790100437.032557:0:14347:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100437.032566:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100437.032595:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790100437.032601:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790100437.138386:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100437.138561:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127304320 00000100:00100000:0.0:1790100437.138571:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127304320 00000100:00100000:0.0:1790100437.138639:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:0.0:1790100437.138649:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+25:11427:x1877056127304320:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100437.138671:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100437.138692:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287519 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2f6 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100437.138804:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287520 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100437.138825:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287520 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100437.138837:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287520 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100437.138849:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790100437.138951:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287519 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2f6 expref: 28 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100437.138967:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287520 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2f6 expref: 27 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100437.138974:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:0.0:1790100437.138977:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790100437.138981:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47600, rc 0) 00000100:00100000:0.0:1790100437.139029:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+27:11427:x1877056127304320:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 382us (651us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1790100437.139036:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00080000:3.0:1790100437.139366:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100437.156260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100437.156439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127304448 00000100:00100000:3.0:1790100437.156450:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127304448 00000100:00100000:3.0:1790100437.156528:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:3.0:1790100437.156539:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+27:11427:x1877056127304448:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1790100437.156599:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156614:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156633:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156666:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156674:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156681:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156687:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100437.156692:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156699:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156712:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:3.0:1790100437.156715:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100437.156720:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100437.156727:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828752e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100437.156805:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+27:11427:x1877056127304448:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 268us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100437.156813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:0.0:1790100437.251804:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100437.251925:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127304576 00000100:00100000:2.0:1790100437.251935:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127304576 00000100:00080000:3.0:1790100437.251997:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100437.252045:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:2.0:1790100437.252062:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2419:x1877056127304576:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790100437.252083:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100437.252101:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f2298287535 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e2fd expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100437.252138:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6ab2c3d1, atime: 0x6ab2c3d0, ctime: 0x6ab2c3d1, blocks: 0x8 00010000:00010000:2.0:1790100437.252154:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1790100437.252159:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100437.252167:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f2298287535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2fd expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100437.252193:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f2298287535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2fd expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100437.252263:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927400, rc 0) 00000100:00100000:2.0:1790100437.252316:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127304576:12345-192.168.203.13@tcp:101:cat.0 Request processed in 262us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100437.252330:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1790100437.255551:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100437.255658:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127304704 00000100:00100000:0.0:1790100437.255668:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127304704 00002000:00100000:0.0:1790100437.255718:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff92608481ad80 x1877056127304704/t0(0) o3->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:733/0 lens 488/0 e 0 to 0 dl 1790100448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790100437.255729:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92608481ad80 with x1877056127304704 ext(0->4095) 00002000:00010000:0.0:1790100437.255734:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92608481ad80 00000100:00100000:0.0:1790100437.255785:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1790100437.255795:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2421:x1877056127304704:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:0.0:1790100437.255988:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2421:x1877056127304704:12345-192.168.203.13@tcp:3:cat.0 Request processed in 194us (442us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790100437.255996:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:0.0:1790100437.256003:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff92608481ad80 x1877056127304704/t0(0) o3->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:733/0 lens 488/4536 e 0 to 0 dl 1790100448 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790100437.256010:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92608481ad80 with x1877056127304704 ext(0->4095) 00002000:00010000:0.0:1790100437.256023:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92608481ad80 00000100:00100000:2.0:1790100437.452092:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140986496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100437.452175:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140986752:0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.452181:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100437.452224:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140986624:0@lo:400:kworker.0 00000100:00100000:3.0:1790100437.452479:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140986496 00000100:00100000:3.0:1790100437.452486:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140986496 00000100:00100000:3.0:1790100437.452540:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790100437.452550:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140986496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100437.452577:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100437.452749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100437.452792:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140987264:0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.452816:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100437.452838:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140987776:0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.452858:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100437.452877:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790100437.452883:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140986880:0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.452916:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100437.452935:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140987392:0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.452959:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100437.452986:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140987904:0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.453006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100437.453600:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140987392 00000100:00100000:1.0:1790100437.453607:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140987392 00000100:00100000:1.0:1790100437.453651:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140987904 00000100:00100000:1.0:1790100437.453654:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140987904 00000100:00100000:1.0:1790100437.453677:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790100437.453685:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140987392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.453746:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140987392:12345-0@lo:400:kworker.0 Request processed in 61us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100437.453753:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790100437.453770:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790100437.453777:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140987904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.453804:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140987904:12345-0@lo:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100437.453809:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790100437.453845:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140987392:0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.453856:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140987904:0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.453897:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140986752 00000100:00100000:1.0:1790100437.456334:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140986752 00000100:00100000:1.0:1790100437.456443:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140987264 00000100:00100000:1.0:1790100437.456446:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140987264 00000100:00100000:1.0:1790100437.456478:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140987776 00000100:00100000:1.0:1790100437.456481:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140987776 00000100:00100000:1.0:1790100437.456500:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790100437.456509:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140986752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.456572:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140987008:0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.456593:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140986752:12345-0@lo:400:kworker.0 Request processed in 85us (3844us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100437.456600:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790100437.456608:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100437.456614:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140987008 00000100:00100000:1.0:1790100437.456617:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140987008 00000100:00100000:1.0:1790100437.456631:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790100437.456636:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140987264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.456666:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140987264:12345-0@lo:400:kworker.0 Request processed in 30us (3850us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100437.456686:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790100437.456699:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790100437.456704:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140987776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.456733:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140987776:12345-0@lo:400:kworker.0 Request processed in 29us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100437.456738:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790100437.456750:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790100437.456756:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140987008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100437.456782:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056140987008:12345-0@lo:400:kworker.0 Request processed in 27us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100437.456788:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790100437.456838:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140986752:0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.456848:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140987520:0@lo:400:kworker.0 00010000:00080000:1.0:1790100437.456853:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92608492ca80 x1877056140987264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100437.456864:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140987264:0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.456874:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790100437.456874:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92608492c700 x1877056140987776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100437.456882:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140987776:0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.456894:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140988032:0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.456914:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100437.456933:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056140987008:0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.456941:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100437.456948:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140988160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100437.456970:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100437.457096:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140986880 00000100:00100000:2.0:1790100437.457100:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140986880 00000100:00100000:2.0:1790100437.457144:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790100437.457159:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140986880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.457962:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140986880:12345-0@lo:400:kworker.0 Request processed in 808us (5042us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100437.457971:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790100437.458002:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140987520 00000100:00100000:2.0:1790100437.458006:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140987520 00000100:00100000:2.0:1790100437.458140:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140988032 00000100:00100000:2.0:1790100437.458144:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140988032 00000100:00100000:2.0:1790100437.458157:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790100437.458298:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140987520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.458354:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140987520:12345-0@lo:400:kworker.0 Request processed in 43us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100437.458360:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790100437.458374:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790100437.458380:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140988032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.458410:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140988032:12345-0@lo:400:kworker.0 Request processed in 31us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100437.458416:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790100437.458450:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140988160 00000100:00100000:2.0:1790100437.458454:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140988160 00000100:00100000:2.0:1790100437.458479:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790100437.458485:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140988160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790100437.458502:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100437.458531:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140988160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100437.458537:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790100437.458589:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140988160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100437.458602:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140987520:0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.458610:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1790100437.458615:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1790100437.458645:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9260831bc000, transno 4294967302 00000100:00100000:0.0:1790100437.459712:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100437.459759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056140987136:0@lo:400:kworker.0 00000100:00100000:0.0:1790100437.459796:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100437.459813:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056140987648:0@lo:400:kworker.0 00000100:00100000:0.0:1790100437.459833:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100437.459887:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140987136 00000100:00100000:0.0:1790100437.459893:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140987136 00000100:00100000:0.0:1790100437.459936:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140987648 00000100:00100000:0.0:1790100437.459939:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140987648 00000100:00100000:0.0:1790100437.459956:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790100437.459962:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877056140987136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100437.460005:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1877056140987136:12345-0@lo:400:kworker.0 Request processed in 43us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100437.460011:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790100437.460024:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790100437.460054:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056140987648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100437.460084:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056140987648:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100437.460089:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790100437.460118:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140986624 00000100:00100000:0.0:1790100437.460122:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140986624 00000100:00100000:0.0:1790100437.460145:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1790100437.460151:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140986624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100437.460184:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056140986624:12345-0@lo:400:kworker.0 Request processed in 33us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100437.460189:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1790100437.460228:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056140986624:0@lo:400:kworker.0 00000100:00100000:0.0:1790100437.460239:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056140987136:0@lo:400:kworker.0 00000100:00100000:0.0:1790100437.460247:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056140987648:0@lo:400:kworker.0 00000100:00080000:0.0:1790100437.460282:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100437.460286:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100437.460290:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100437.460292:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100437.460507:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140986880:0@lo:400:kworker.0 00000100:00100000:3.0:1790100437.462530:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140986496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9974us (10340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100437.462543:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000004:00080000:2.0:1790100437.466639:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1790100437.466693:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92608481bb80, transno 4294967305 00000100:00100000:2.0:1790100437.482946:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140988032:0@lo:400:kworker.0 00000100:00100000:2.0:1790100437.485883:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140986496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790100437.832601:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100438.863824:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100439.384879:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100439.384921:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100439.384955:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100439.384998:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100439.385032:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100439.385048:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100439.385065:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100439.385265:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127304960 00000100:00100000:0.0:1790100439.385276:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127304960 00000100:00100000:0.0:1790100439.385379:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127305472 00000100:00100000:0.0:1790100439.385383:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127305472 00000100:00100000:0.0:1790100439.385398:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127305088 00000100:00100000:0.0:1790100439.385401:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127305088 00000100:00100000:0.0:1790100439.385411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127305600 00000100:00100000:0.0:1790100439.385413:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127305600 00000100:00100000:0.0:1790100439.385438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:0.0:1790100439.385447:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+27:2420:x1877056127304960:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100439.385522:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+27:2420:x1877056127304960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100439.385529:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:0.0:1790100439.385546:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:0.0:1790100439.385553:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127305472:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100439.385575:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127305472:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100439.385581:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:0.0:1790100439.385591:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:0.0:1790100439.385596:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127305088:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100439.385616:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127305088:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 20us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100439.385621:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:0.0:1790100439.385630:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:0.0:1790100439.385635:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127305600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100439.385652:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127305600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 17us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100439.385657:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:0.0:1790100439.385674:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127304832 00000100:00100000:0.0:1790100439.385676:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127304832 00000100:00100000:0.0:1790100439.385697:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 366 00000100:00100000:0.0:1790100439.385703:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127304832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100439.385731:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127304832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100439.385737:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 366 00000100:00080000:1.0:1790100439.385978:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100439.385982:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100439.386321:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127305216 00000100:00100000:2.0:1790100439.386325:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127305216 00000100:00100000:2.0:1790100439.386378:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127305344 00000100:00100000:2.0:1790100439.386382:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127305344 00000100:00100000:2.0:1790100439.386412:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1790100439.386419:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2420:x1877056127305216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100439.386441:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2420:x1877056127305216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100439.386445:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1790100439.386453:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:2.0:1790100439.386457:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127305344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100439.386469:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127305344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 12us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100439.386472:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00080000:1.0:1790100439.386925:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100439.386930:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790100439.880807:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100440.521263:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140988288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100440.521366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100440.521737:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140988416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100440.521769:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100440.521811:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140988288 00000100:00100000:0.0:1790100440.521818:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140988288 00000100:00100000:0.0:1790100440.521866:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140988416 00000100:00100000:0.0:1790100440.521870:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140988416 00000100:00100000:0.0:1790100440.521887:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790100440.521895:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056140988288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100440.521932:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790100440.521978:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056140988288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100440.521985:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790100440.522001:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790100440.522007:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140988416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100440.522016:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790100440.522042:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140988416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100440.522048:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1790100440.522063:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100440.522127:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140988288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100440.522159:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261bccb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140988416:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1790100440.531129:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1790100440.531136:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000001:00080000:0.0:1790100440.531148:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:3.0:1790100440.531167:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff926083d55600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1790100440.531172:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083031f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff926083d55e40 00000020:00080000:3.0:1790100440.531175:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083031400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff926184bb0a00 00000020:00080000:0.0:1790100440.531214:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1790100440.531285:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1790100440.531321:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1790100440.531517:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100440.531528:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100440.531595:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100440.531602:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100440.531607:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100440.531614:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100440.531638:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff926083e1be00) 00010000:00010000:3.0:1790100440.531640:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100440.531645:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100440.531651:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982874b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100440.904509:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100441.034104:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100441.034123:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608481aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140988544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100441.034190:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100441.034578:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140988544 00000100:00100000:2.0:1790100441.034586:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140988544 00000100:00100000:2.0:1790100441.034651:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790100441.034670:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140988544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100441.034699:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1790100441.034754:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140988544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100441.034761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790100441.035649:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608481aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140988544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790100441.936404:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100442.056678:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100442.056699:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140988672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100442.056758:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100442.056846:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140988672 00000100:00100000:2.0:1790100442.056926:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140988672 00000100:00100000:2.0:1790100442.056974:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790100442.056982:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140988672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100442.057010:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100442.057047:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056140988672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100442.057054:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790100442.057155:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140988672:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1790100442.502910:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790100442.568611:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140989184:0@lo:400:kworker.0 00000100:00100000:1.0:1790100442.568671:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100442.568730:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140989696:0@lo:400:kworker.0 00000100:00100000:1.0:1790100442.568762:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100442.568776:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140990208:0@lo:400:kworker.0 00000100:00100000:1.0:1790100442.568791:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100442.568813:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790100442.568817:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140989056:0@lo:400:kworker.0 00000100:00100000:1.0:1790100442.568832:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100442.568843:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140989568:0@lo:400:kworker.0 00000100:00100000:3.0:1790100442.568947:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140989056 00000100:00100000:3.0:1790100442.568956:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140989056 00000100:00100000:3.0:1790100442.568998:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790100442.569008:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140989056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100442.569057:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140989056:12345-0@lo:400:kworker.0 Request processed in 51us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100442.569074:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790100442.569712:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100442.569741:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140990080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100442.569777:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100442.569813:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140989056:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570443:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140988800:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570479:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100442.570520:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140989312:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100442.570563:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140989824:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570582:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100442.570600:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790100442.570606:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140988928:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570626:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100442.570643:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140989440:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570663:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100442.570679:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140989952:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100442.570730:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140989184 00000100:00100000:0.0:1790100442.570734:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140989184 00000100:00100000:0.0:1790100442.570768:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140989312 00000100:00100000:0.0:1790100442.570772:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140989312 00000100:00100000:0.0:1790100442.570793:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140989824 00000100:00100000:0.0:1790100442.570806:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140989824 00000100:00100000:0.0:1790100442.570822:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140988928 00000100:00100000:0.0:1790100442.570825:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140988928 00000100:00100000:0.0:1790100442.570837:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140989440 00000100:00100000:0.0:1790100442.570840:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140989440 00000100:00100000:0.0:1790100442.570863:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140989952 00000100:00100000:0.0:1790100442.570866:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140989952 00000100:00100000:0.0:1790100442.570881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790100442.570887:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140989184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570931:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056140989184:12345-0@lo:400:kworker.0 Request processed in 44us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.570937:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790100442.570951:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790100442.570957:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140989312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.570986:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056140989312:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.570991:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790100442.571025:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790100442.571051:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140989824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571088:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056140989824:12345-0@lo:400:kworker.0 Request processed in 57us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.571093:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790100442.571105:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1790100442.571111:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140988928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571135:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056140988928:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.571141:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1790100442.571159:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790100442.571164:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140989440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571188:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056140989440:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.571193:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790100442.571201:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790100442.571205:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140989952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571223:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056140989952:12345-0@lo:400:kworker.0 Request processed in 18us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.571227:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790100442.571251:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140989696 00000100:00100000:0.0:1790100442.571255:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140989696 00000100:00100000:0.0:1790100442.571270:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140990208 00000100:00100000:0.0:1790100442.571272:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140990208 00000100:00100000:0.0:1790100442.571280:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140989568 00000100:00100000:0.0:1790100442.571282:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140989568 00000100:00100000:0.0:1790100442.571289:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140990080 00000100:00100000:0.0:1790100442.571292:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140990080 00000100:00100000:0.0:1790100442.571301:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790100442.571306:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140989696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571329:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140989696:12345-0@lo:400:kworker.0 Request processed in 23us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.571334:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790100442.571373:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790100442.571379:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140990208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571400:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140990208:12345-0@lo:400:kworker.0 Request processed in 22us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.571412:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790100442.571421:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790100442.571425:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140989568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571445:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140989568:12345-0@lo:400:kworker.0 Request processed in 20us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.571450:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790100442.571458:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790100442.571462:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140990080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571478:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140990080:12345-0@lo:400:kworker.0 Request processed in 17us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.571483:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1790100442.571505:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100442.571509:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100442.571511:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100442.571513:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100442.571529:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056140988928:0@lo:400:kworker.0 00010000:00080000:0.0:1790100442.571539:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260848c1500 x1877056140989440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100442.571549:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056140989440:0@lo:400:kworker.0 00010000:00080000:0.0:1790100442.571556:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260848c2300 x1877056140989952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100442.571563:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056140989952:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571570:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056140989312:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571576:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056140989824:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571608:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140989568:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571615:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140990080:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571624:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056140989184:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571631:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1790100442.571635:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1790100442.571648:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140989696:0@lo:400:kworker.0 00000100:00100000:0.0:1790100442.571658:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140990208:0@lo:400:kworker.0 00000100:00100000:3.0:1790100442.572241:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140988800 00000100:00100000:3.0:1790100442.572247:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140988800 00000100:00100000:3.0:1790100442.572284:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1790100442.572292:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140988800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100442.572368:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140988800:12345-0@lo:400:kworker.0 Request processed in 76us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100442.572375:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1790100442.572483:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140988800:0@lo:400:kworker.0 00000100:00100000:2.0:1790100442.575939:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100442.575959:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608481b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140990336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100442.576029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100442.576201:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140990336 00000100:00100000:3.0:1790100442.576209:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140990336 00000100:00100000:3.0:1790100442.576255:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790100442.576263:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140990336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790100442.576290:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100442.576334:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140990336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100442.576361:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790100442.576406:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608481b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140990336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100442.576668:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140990464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100442.576697:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100442.576961:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140990464 00000100:00100000:2.0:1790100442.576966:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140990464 00000100:00100000:2.0:1790100442.577032:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790100442.577041:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140990464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100442.577053:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100442.577109:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140990464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100442.577115:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790100442.577181:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140990464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100442.705304:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100442.705425:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127305728 00000100:00100000:0.0:1790100442.705434:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127305728 00000100:00100000:0.0:1790100442.705510:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:0.0:1790100442.705521:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+13:11071:x1877056127305728:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790100442.705642:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+13:11071:x1877056127305728:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 122us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100442.705651:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00080000:2.0:1790100442.705994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100442.708673:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100442.708766:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127305856 00000100:00100000:2.0:1790100442.708775:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127305856 00000100:00100000:2.0:1790100442.708844:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:2.0:1790100442.708870:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:11071:x1877056127305856:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790100442.708959:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:11071:x1877056127305856:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100442.708966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00080000:0.0:1790100442.709613:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790100442.711407:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100442.711488:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127306112 00000100:00100000:1.0:1790100442.711495:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127306112 00000100:00100000:1.0:1790100442.711553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1790100442.711563:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+13:11071:x1877056127306112:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790100442.711779:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+14:11071:x1877056127306112:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 217us (377us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790100442.711787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000040:00080000:0.0:1790100442.760950:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100442.760960:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100442.761148:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1790100442.761156:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790100443.035615:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100443.976641:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100444.504573:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100444.504615:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100444.504640:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100444.504660:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100444.504676:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100444.504707:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100444.504731:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100444.504756:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127306496 00000100:00100000:3.0:1790100444.504764:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127306496 00000100:00100000:3.0:1790100444.504815:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127307008 00000100:00100000:3.0:1790100444.504823:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127307008 00000100:00100000:3.0:1790100444.504841:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127306368 00000100:00100000:3.0:1790100444.504843:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127306368 00000100:00100000:3.0:1790100444.504856:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127306880 00000100:00100000:3.0:1790100444.504858:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127306880 00000100:00100000:3.0:1790100444.504875:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:3.0:1790100444.504885:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127306496:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100444.504968:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127306496:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 84us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100444.504976:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:3.0:1790100444.505073:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:3.0:1790100444.505082:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127307008:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100444.505108:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127306240 00000100:00100000:0.0:1790100444.505116:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127306240 00000100:00100000:3.0:1790100444.505118:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127307008:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100444.505126:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:3.0:1790100444.505145:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:3.0:1790100444.505154:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+14:2420:x1877056127306368:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100444.505162:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 368 00000100:00100000:0.0:1790100444.505179:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127306240:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100444.505213:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127306240:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100444.505220:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 368 00000100:00100000:3.0:1790100444.505236:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+14:2420:x1877056127306368:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 83us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100444.505244:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:0.0:1790100444.505256:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:0.0:1790100444.505265:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127306880:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100444.505309:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127306880:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100444.505317:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:3.0:1790100444.505327:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127306752 00000100:00100000:3.0:1790100444.505334:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127306752 00000100:00100000:0.0:1790100444.505364:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127306624 00000100:00100000:0.0:1790100444.505370:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127306624 00000100:00100000:0.0:1790100444.505400:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1790100444.505411:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2420:x1877056127306624:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100444.505438:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:0.0:1790100444.505444:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2420:x1877056127306624:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100444.505450:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127306752:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100444.505457:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00080000:0.0:1790100444.505479:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100444.505484:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127306752:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (841us total) trans 0 rc 0/0 00000100:00080000:0.0:1790100444.505485:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100444.505489:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100444.505491:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790100444.505503:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00010000:00010000:0.0:1790100445.005975:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790100445.069686:0:14544:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:07:22 (1790100442) 00000100:00100000:0.0:1790100445.640540:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100445.640560:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b2570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140990592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100445.640631:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100445.640695:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140990592 00000100:00100000:0.0:1790100445.640703:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140990592 00000100:00100000:0.0:1790100445.640760:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790100445.640768:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140990592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100445.640793:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790100445.640829:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140990592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100445.640835:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1790100445.640853:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100445.640882:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b2570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140990592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100445.641236:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140990720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100445.641262:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100445.641331:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140990720 00000100:00100000:2.0:1790100445.641357:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140990720 00000100:00100000:2.0:1790100445.641400:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790100445.641408:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140990720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100445.641418:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790100445.641452:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140990720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100445.641458:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790100445.641490:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140990720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790100445.641915:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790100446.024579:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100446.314756:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608481b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140990848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100446.314820:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100446.315147:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140990848 00000100:00100000:0.0:1790100446.315154:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140990848 00000100:00100000:0.0:1790100446.315217:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790100446.315227:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140990848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790100446.315259:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1790100446.318226:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140990848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2991us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100446.318239:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790100446.318409:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608481b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140990848:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1790100446.674721:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1790100446.674734:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1790100446.674804:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1790100446.674820:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790100446.724085:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100446.725549:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127307264 00000100:00100000:3.0:1790100446.725560:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127307264 00000100:00100000:3.0:1790100446.725662:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:3.0:1790100446.725674:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+13:12145:x1877056127307264:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100446.725692:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100446.725710:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828753c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e304 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790100446.726243:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100446.726375:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100446.726668:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100446.726685:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.728444:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.728461:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.728472:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.728800:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287551 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.728810:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287551 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.728837:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287551 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100446.728849:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1790100446.729106:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729115:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729122:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729129:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100446.729133:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729141:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729153:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff926083e1b100) 00010000:00010000:2.0:1790100446.729156:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100446.729161:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729168:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f2298287543 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729182:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729189:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729211:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729217:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100446.729220:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729228:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729236:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff926183194500) 00010000:00010000:2.0:1790100446.729239:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100446.729242:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.729248:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828754a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.733413:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f229828753c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e304 expref: 16 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.733441:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287551 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e304 expref: 15 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100446.733450:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:2.0:1790100446.733452:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100446.733457:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927600, rc 0) 00000100:00100000:2.0:1790100446.734418:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+15:12145:x1877056127307264:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 8744us (10343us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1790100446.734453:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:0.0:1790100446.751824:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100446.751905:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127307392 00000100:00100000:2.0:1790100446.751915:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127307392 00000100:00100000:2.0:1790100446.751969:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:2.0:1790100446.751984:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+15:12145:x1877056127307392:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790100446.752098:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+15:12145:x1877056127307392:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100446.752106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:0.0:1790100446.762462:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100446.762804:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127307520 00000100:00100000:1.0:1790100446.762814:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127307520 00000100:00100000:1.0:1790100446.762879:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1790100446.762890:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+15:2419:x1877056127307520:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100446.762914:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100446.762937:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287551 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e304 expref: 15 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100446.762956:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:1.0:1790100446.762961:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100446.763025:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+14:2419:x1877056127307520:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 137us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100446.763041:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1790100446.765820:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100446.765955:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127307648 00000100:00100000:1.0:1790100446.765963:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127307648 00000100:00100000:1.0:1790100446.766060:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:1.0:1790100446.766070:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:12145:x1877056127307648:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790100446.766158:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:12145:x1877056127307648:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 90us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100446.766165:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00080000:2.0:1790100446.766554:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1790100446.856694:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100446.856703:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100446.856720:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1790100446.856729:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790100447.052252:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100447.176779:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100447.176802:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140990976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100447.176876:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100447.176983:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140990976 00000100:00100000:2.0:1790100447.176992:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140990976 00000100:00100000:2.0:1790100447.177047:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790100447.177217:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140990976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100447.177252:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100447.177300:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140990976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 245us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.177307:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790100447.177419:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140990976:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1790100447.628537:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790100447.688741:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140991360:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.688806:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100447.688863:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140991872:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.688889:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100447.688913:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140992384:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.688947:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100447.689471:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790100447.689482:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140991488:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.689579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100447.689606:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140992000:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.689629:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100447.689648:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140992512:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.689669:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100447.689705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140991360 00000100:00100000:1.0:1790100447.689711:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140991360 00000100:00100000:1.0:1790100447.689751:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790100447.689760:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140991360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.689810:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140991360:12345-0@lo:400:kworker.0 Request processed in 51us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100447.689817:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790100447.689838:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140991872 00000100:00100000:1.0:1790100447.689842:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140991872 00000100:00100000:1.0:1790100447.689866:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140992384 00000100:00100000:1.0:1790100447.689869:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140992384 00000100:00100000:1.0:1790100447.689881:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140992000 00000100:00100000:1.0:1790100447.689883:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140992000 00000100:00100000:1.0:1790100447.689894:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140992512 00000100:00100000:1.0:1790100447.689896:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140992512 00000100:00100000:1.0:1790100447.689911:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790100447.689917:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140991872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.689957:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140991872:12345-0@lo:400:kworker.0 Request processed in 40us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100447.689963:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790100447.689975:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790100447.689980:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140992384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100447.690082:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140991488 00000100:00100000:3.0:1790100447.690087:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140991488 00000100:00100000:3.0:1790100447.690114:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790100447.690119:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140991488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100447.690151:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140991488:12345-0@lo:400:kworker.0 Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100447.690163:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790100447.690295:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140991104:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690328:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100447.690390:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140991616:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100447.690443:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140992128:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100447.690479:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140992640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100447.690512:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100447.690532:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790100447.690538:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140991232:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690557:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100447.690574:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140991744:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690592:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100447.690608:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140992256:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690625:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100447.690648:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790100447.690656:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b7be2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140992000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690685:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b7be2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140992000:12345-0@lo:400:kworker.0 Request processed in 30us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.690691:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790100447.690703:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790100447.690709:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140992512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690735:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140992512:12345-0@lo:400:kworker.0 Request processed in 26us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.690740:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1790100447.690754:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100447.690758:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100447.690766:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140991616 00000100:00100000:2.0:1790100447.690774:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140991616 00000100:00100000:2.0:1790100447.690798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140992128 00000100:00100000:2.0:1790100447.690801:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140992128 00000100:00100000:2.0:1790100447.690813:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140991232 00000100:00100000:2.0:1790100447.690816:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140991232 00000100:00100000:2.0:1790100447.690825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140991744 00000100:00100000:2.0:1790100447.690828:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140991744 00000100:00100000:2.0:1790100447.690839:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140992256 00000100:00100000:2.0:1790100447.690841:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140992256 00000100:00100000:2.0:1790100447.690855:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790100447.690860:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140991616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690892:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140991616:12345-0@lo:400:kworker.0 Request processed in 31us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.690897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790100447.690911:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790100447.690918:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140992128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690941:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140992128:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.690946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790100447.690956:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790100447.690960:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140991232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.690982:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140991232:12345-0@lo:400:kworker.0 Request processed in 22us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.690987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790100447.691010:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1790100447.691016:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140991744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.691051:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140991744:12345-0@lo:400:kworker.0 Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.691065:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1790100447.691077:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790100447.691083:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140992256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.691108:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140992256:12345-0@lo:400:kworker.0 Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.691113:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790100447.691135:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140992640 00000100:00100000:2.0:1790100447.691138:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140992640 00000100:00100000:2.0:1790100447.691158:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790100447.691163:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1877056140992640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790100447.691182:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100447.691208:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1877056140992640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100447.691213:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1790100447.691231:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100447.691234:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100447.691257:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140991232:0@lo:400:kworker.0 00010000:00080000:2.0:1790100447.691269:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260848c1180 x1877056140991744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100447.691279:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140991744:0@lo:400:kworker.0 00010000:00080000:2.0:1790100447.691287:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260848c0380 x1877056140992256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100447.691294:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140992256:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.691301:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140991616:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.691317:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140992128:0@lo:400:kworker.0 00000100:00100000:2.0:1790100447.691328:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140992640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100447.691751:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140992384:12345-0@lo:400:kworker.0 Request processed in 1770us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100447.691759:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790100447.691916:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140991488:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.691925:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140992000:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.691933:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140992512:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.691943:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140991360:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.691951:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140991872:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.691958:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140992384:0@lo:400:kworker.0 00000100:00100000:0.0:1790100447.692292:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260849c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140992768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100447.692326:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100447.693197:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140991104 00000100:00100000:3.0:1790100447.693204:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140991104 00000100:00100000:3.0:1790100447.693263:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1790100447.693271:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140991104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100447.693321:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3643:x1877056140991104:12345-0@lo:400:kworker.0 Request processed in 51us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100447.693327:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1790100447.693418:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056140991104:0@lo:400:kworker.0 00000100:00100000:1.0:1790100447.696259:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140992768 00000100:00100000:1.0:1790100447.696272:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140992768 00000100:00100000:1.0:1790100447.696329:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790100447.696358:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140992768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100447.696392:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790100447.699251:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056140992768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2907us (6915us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100447.699264:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790100447.702724:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260849c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140992768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790100448.072703:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100449.098527:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100449.571417:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100449.571564:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127307776 00000100:00100000:2.0:1790100449.571577:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127307776 00000100:00080000:3.0:1790100449.571657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100449.571680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:2.0:1790100449.571693:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+14:12187:x1877056127307776:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100449.571725:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100449.571745:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f229828755f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e30b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571807:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571821:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571831:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571845:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571853:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571859:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571948:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571957:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571963:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571968:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100449.571972:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571979:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.571989:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:2.0:1790100449.571992:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100449.571997:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572003:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572022:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572028:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572034:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572045:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100449.572049:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572055:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572064:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff926183194200) 00010000:00010000:2.0:1790100449.572066:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100449.572070:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572076:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828756d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572108:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f229828755f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e30b expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572118:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:2.0:1790100449.572120:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100449.572124:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f229828755f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e30b expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.572134:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926e00, rc 0) 00000100:00100000:2.0:1790100449.572203:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+14:12187:x1877056127307776:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 512us (801us total) trans 0 rc 301/301 00000100:00100000:2.0:1790100449.572209:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:1.0:1790100449.587367:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100449.587523:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127308032 00000100:00100000:2.0:1790100449.587542:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127308032 00000100:00100000:2.0:1790100449.587878:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:2.0:1790100449.587891:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+14:12187:x1877056127308032:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:2.0:1790100449.587983:0:9338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100449.588027:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d400/0xc87a4f2298286ec1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e136 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588050:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261900b4e00) 00010000:00010000:2.0:1790100449.588066:0:9338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100449.588136:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588152:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588164:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588180:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588187:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588196:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588906:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588919:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588932:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100449.588949:0:9338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fbf6c4a reply state 0000000064bd32a4 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588960:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588966:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100449.588969:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100449.588972:0:9338:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790100449.588977:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790100449.588984:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588990:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.588997:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.589003:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100449.589007:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.591697:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.591729:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:2.0:1790100449.591732:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100449.591750:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.591758:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287574 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100449.591788:0:9338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fbf6c4a reply state 0000000064bd32a4 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.591801:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.591809:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff926183194600) 00010000:00010000:2.0:1790100449.591812:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100449.591815:0:9338:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790100449.591947:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+15:12187:x1877056127308032:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 4054us (4615us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1790100449.593057:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:1.0:1790100449.628964:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.629005:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.629048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.629081:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.629102:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.629126:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.629157:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127308672 00000100:00100000:1.0:1790100449.629169:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127308672 00000100:00100000:1.0:1790100449.629252:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127308288 00000100:00100000:1.0:1790100449.629255:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127308288 00000100:00100000:1.0:1790100449.629278:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127308800 00000100:00100000:1.0:1790100449.629281:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127308800 00000100:00100000:1.0:1790100449.629299:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:1.0:1790100449.629310:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127308672:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100449.629414:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127308672:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 106us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.629422:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:1.0:1790100449.629440:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:1.0:1790100449.629446:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127308288:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100449.629467:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127308288:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.629473:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:1.0:1790100449.629482:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:1.0:1790100449.629487:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127308800:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100449.629504:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127308800:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 17us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.629520:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:1.0:1790100449.629542:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127308416 00000100:00100000:1.0:1790100449.629545:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127308416 00000100:00100000:1.0:1790100449.629568:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127308544 00000100:00100000:1.0:1790100449.629570:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127308544 00000100:00100000:1.0:1790100449.629585:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:1.0:1790100449.629591:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127308416:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100449.629614:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127308416:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.629620:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:1.0:1790100449.629629:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:1.0:1790100449.629634:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127308544:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100449.629651:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127308544:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 16us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.629656:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00080000:1.0:1790100449.629682:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100449.629686:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100449.629689:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100449.629691:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100449.629937:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127308160 00000100:00100000:0.0:1790100449.629943:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127308160 00000100:00100000:0.0:1790100449.629982:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 370 00000100:00100000:0.0:1790100449.629989:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127308160:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100449.630034:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127308160:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 45us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100449.630041:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 370 00000100:00100000:1.0:1790100449.693404:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100449.693607:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127308928 00000100:00100000:2.0:1790100449.693622:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127308928 00000100:00100000:2.0:1790100449.693735:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:2.0:1790100449.693748:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+15:12195:x1877056127308928:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:2.0:1790100449.693778:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100449.693806:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e312 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.693888:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.693905:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.693942:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100449.693998:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790100449.694002:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100449.694042:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.694071:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e312 expref: 17 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.694093:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e312 expref: 16 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.694103:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:2.0:1790100449.694106:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100449.694111:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926e00, rc 0) 00000100:00100000:2.0:1790100449.694197:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+16:12195:x1877056127308928:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 451us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100449.694206:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:0.0:1790100449.759732:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.759848:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127309056 00000100:00100000:1.0:1790100449.759857:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127309056 00000100:00100000:1.0:1790100449.760101:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:1.0:1790100449.760112:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+16:12201:x1877056127309056:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790100449.760131:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100449.760149:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e319 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760220:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760234:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760246:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760254:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760262:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760268:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760747:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982875ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760758:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982875ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.760767:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982875ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100449.760845:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790100449.760848:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100449.760877:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982875ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761092:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761110:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761117:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761123:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ee00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100449.761128:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761145:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761165:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:1.0:1790100449.761168:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100449.761173:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761178:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f229828759e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761201:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761208:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761226:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761237:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8fe00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100449.761240:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761247:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761254:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff926183194600) 00010000:00010000:1.0:1790100449.761256:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100449.761259:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761265:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f22982875a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761301:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e319 expref: 18 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761330:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982875ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e319 expref: 17 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.761498:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100449.761502:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790100449.761504:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f600, rc 0) 00000100:00100000:1.0:1790100449.761582:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+17:12201:x1877056127309056:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1471us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.761590:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:3.0:1790100449.763941:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.764167:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127309312 00000100:00100000:1.0:1790100449.764185:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127309312 00000100:00100000:1.0:1790100449.764293:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:1.0:1790100449.764304:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+17:12201:x1877056127309312:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790100449.764325:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100449.764380:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f22982875b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e320 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.764487:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.764503:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.764515:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.764564:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.764572:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.764579:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790100449.764890:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1790100449.765096:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765104:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765121:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765150:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765156:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765162:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765166:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100449.765170:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765178:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765189:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100449.765191:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100449.765194:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765199:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100449.765210:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004541c565 reply state 000000000d204317 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765219:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765229:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1964600) 00010000:00010000:1.0:1790100449.765231:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100449.765233:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790100449.765258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f22982875b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765271:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.765277:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964200) 00010000:00010000:1.0:1790100449.765279:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100449.765280:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e400, rc 0) 00000100:00100000:1.0:1790100449.765457:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+20:12201:x1877056127309312:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1154us (1522us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1790100449.765465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:2.0:1790100449.769070:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.769159:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127309440 00000100:00100000:1.0:1790100449.769168:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127309440 00000100:00100000:1.0:1790100449.769245:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1790100449.769254:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127309440:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790100449.769270:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100449.769287:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e327 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100449.769309:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100449.769328:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:1.0:1790100449.769333:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100449.769573:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.769593:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.769604:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e800, rc 0) 00000100:00100000:1.0:1790100449.769658:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2420:x1877056127309440:12345-192.168.203.13@tcp:101:bash.0 Request processed in 405us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.769665:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1790100449.771859:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.771946:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127309568 00000100:00100000:1.0:1790100449.771954:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127309568 00000100:00100000:1.0:1790100449.772043:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1790100449.772052:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+6:12201:x1877056127309568:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790100449.772065:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100449.772079:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e32e expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.772105:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.772114:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100449.772117:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100449.772122:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.772148:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.772171:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 7 pid: 8425 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100449.772185:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260849c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1877056140992896:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100449.772270:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff926184ed3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100449.774647:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260849c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1877056140992896:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100449.774676:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.774695:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e000, rc 0) 00000100:00100000:1.0:1790100449.774838:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:12201:x1877056127309568:12345-192.168.203.13@tcp:101:bash.0 Request processed in 2785us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.774847:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:0.0:1790100449.775054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100449.775142:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127309696 00000100:00100000:3.0:1790100449.775149:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127309696 00010000:00010000:3.0:1790100449.775179:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 7 pid: 8425 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100449.775284:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1790100449.775294:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127309696:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100449.775315:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100449.775333:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 7 pid: 8425 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.775361:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 7 pid: 8425 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.775390:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982875d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e327 expref: 7 pid: 8425 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.775404:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100449.775408:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100449.775415:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.775424:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.775452:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100449.775464:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1877056140993024:192.168.203.13@tcp:105: 00000100:00100000:3.0:1790100449.775516:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100449.777497:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1877056140993024:192.168.203.13@tcp:105: 00010000:00010000:3.0:1790100449.777514:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100449.777557:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127309696:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2264us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100449.777566:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:0.0:1790100449.778220:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100449.778261:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127309952 00000100:00100000:3.0:1790100449.778267:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127309952 00000100:00100000:3.0:1790100449.778323:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1790100449.778369:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+20:12201:x1877056127309952:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1790100449.778623:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+21:12201:x1877056127309952:12345-192.168.203.13@tcp:35:bash.0 Request processed in 257us (404us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1790100449.778630:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1790100449.840997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100449.841114:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127310208 00000100:00100000:2.0:1790100449.841124:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127310208 00000100:00100000:2.0:1790100449.841199:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:2.0:1790100449.841209:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+21:12211:x1877056127310208:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100449.841231:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100449.841251:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982875e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e335 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100449.841400:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790100449.841948:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982875e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e335 expref: 23 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.841963:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:2.0:1790100449.841966:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100449.841971:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982875e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e335 expref: 23 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.841986:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926a00, rc 0) 00000100:00100000:2.0:1790100449.842091:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+22:12211:x1877056127310208:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 883us (1103us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1790100449.842109:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:2.0:1790100449.857907:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100449.863071:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127310464 00000100:00100000:3.0:1790100449.863085:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127310464 00000100:00100000:3.0:1790100449.863468:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1790100449.863492:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+22:12211:x1877056127310464:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790100449.863792:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+23:12211:x1877056127310464:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 302us (5893us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1790100449.863800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1790100449.915902:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.916003:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127310592 00000100:00100000:1.0:1790100449.916022:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127310592 00000100:00100000:1.0:1790100449.916083:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:1.0:1790100449.916093:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+23:12217:x1877056127310592:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100449.916116:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100449.916133:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f22982875f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e33c expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.916197:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.916227:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.916306:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100449.916444:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790100449.916449:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100449.916561:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.916588:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f22982875f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e33c expref: 25 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.916605:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e33c expref: 24 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.916613:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100449.916616:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100449.916618:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f400, rc 0) 00000100:00100000:1.0:1790100449.916668:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12217:x1877056127310592:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 577us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.916675:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:2.0:1790100449.929564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100449.930190:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127310848 00000100:00100000:1.0:1790100449.930200:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127310848 00000100:00100000:1.0:1790100449.930492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:1.0:1790100449.930505:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12217:x1877056127310848:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100449.930526:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100449.930558:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287600 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e343 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.930663:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287607 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.930676:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287607 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.930688:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287607 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100449.930699:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790100449.930809:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287600 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e343 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.930827:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287607 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e343 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.930836:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964200) 00010000:00010000:1.0:1790100449.930839:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100449.930842:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8fe00, rc 0) 00000100:00100000:1.0:1790100449.930893:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+26:12217:x1877056127310848:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 392us (1337us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1790100449.930900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00010000:00010000:2.0:1790100450.120531:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100450.194686:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100450.194730:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100450.194758:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127311232 00000100:00100000:0.0:1790100450.194767:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127311232 00000100:00100000:0.0:1790100450.194821:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1790100450.194832:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+26:2422:x1877056127311232:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100450.194846:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100450.194881:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287607 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e343 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.194898:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964200) 00010000:00010000:0.0:1790100450.194903:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100450.194951:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+25:2422:x1877056127311232:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 121us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100450.194958:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1790100450.195628:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127311104 00000100:00100000:3.0:1790100450.195634:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127311104 00000100:00100000:3.0:1790100450.195705:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:3.0:1790100450.195713:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261bccb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12217:x1877056127311104:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100450.195730:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100450.195744:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f2298287615 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e34a expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.195831:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828761c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.195844:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828761c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.195854:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828761c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100450.195878:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790100450.195968:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f2298287615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e34a expref: 28 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.195983:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828761c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e34a expref: 27 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.195991:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964200) 00010000:00010000:3.0:1790100450.195994:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790100450.195997:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030c00, rc 0) 00000100:00100000:3.0:1790100450.196051:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261bccb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12217:x1877056127311104:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 339us (1374us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1790100450.196058:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:0.0:1790100450.213191:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100450.213287:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127311360 00000100:00100000:2.0:1790100450.213296:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127311360 00000100:00100000:2.0:1790100450.213384:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1790100450.213394:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2419:x1877056127311360:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:2.0:1790100450.213435:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.213454:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.213489:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100450.213493:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100450.213497:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.213531:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.213545:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 6 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.213559:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1877056140993152:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100450.213644:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100450.231828:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100450.231982:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1877056140993152:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100450.232025:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100450.236869:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127311488 00000100:00100000:0.0:1790100450.236882:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127311488 00002000:00100000:0.0:1790100450.236939:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9260848c3800 x1877056127311488/t0(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:746/0 lens 504/0 e 0 to 0 dl 1790100461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790100450.236959:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9260848c3800 with x1877056127311488 ext(0->12) 00010000:00010000:0.0:1790100450.236968:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 7 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.236986:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 7 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100450.237143:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9260848c3800 00000100:00100000:0.0:1790100450.237179:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1790100450.237190:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2421:x1877056127311488:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:1.0:1790100450.253077:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2421:x1877056127311488:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 15879us (21248us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790100450.253091:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:1.0:1790100450.253104:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9260848c3800 x1877056127311488/t4294967306(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:746/0 lens 504/448 e 0 to 0 dl 1790100461 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100450.253114:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9260848c3800 with x1877056127311488 ext(0->12) 00010000:00010000:1.0:1790100450.253124:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 9 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.253143:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 9 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100450.253150:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9260848c3800 00000100:00100000:0.0:1790100450.279025:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100450.279155:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127311616 00000100:00100000:1.0:1790100450.279166:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127311616 00010000:00010000:1.0:1790100450.279204:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 9 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100450.279245:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:1.0:1790100450.279254:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2419:x1877056127311616:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100450.279269:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790100450.279283:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790100450.279287:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790100449 00002000:00010000:1.0:1790100450.279289:0:6499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790100449 00002000:00010000:1.0:1790100450.279304:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1790100449 00002000:00010000:1.0:1790100450.279306:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790100450.279313:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 9 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.279326:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 9 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.279388:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f22982875dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e32e expref: 9 pid: 8426 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.279407:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100450.279411:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100450.279416:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.279426:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.279469:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100450.279513:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2419:x1877056127311616:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 260us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.279520:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:2.0:1790100450.280292:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.280303:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.280323:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.280331:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.280390:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.280398:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100450.280402:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.280411:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.280425:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.280432:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f67553f3/0xc87a4f229828762a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.280498:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127311360:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 67104us (67316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.280505:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1790100450.285522:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100450.285868:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127311872 00000100:00100000:1.0:1790100450.285878:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127311872 00000100:00100000:1.0:1790100450.285953:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:1.0:1790100450.285965:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12217:x1877056127311872:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:1.0:1790100450.286154:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828761c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e34a expref: 27 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100450.286316:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1790100450.286364:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1790100450.288491:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1790100450.288544:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.288575:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.288585:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.288622:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.288637:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 31 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100450.288651:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260849c8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877056140993280:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100450.288743:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff926184ed3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100450.304236:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100450.304302:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127312000 00000100:00100000:3.0:1790100450.304310:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127312000 00010000:00010000:3.0:1790100450.304383:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 32 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100450.304437:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:3.0:1790100450.304446:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+32:2422:x1877056127312000:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100450.304459:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100450.304466:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 32 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.304479:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 32 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.304519:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964200) 00010000:00010000:3.0:1790100450.304524:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.304533:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.304541:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.304558:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100450.305585:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f22982875c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e320 expref: 32 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.305601:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260849c8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877056140993280:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100450.305619:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.305635:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.305640:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100450.305762:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1790100450.305867:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1790100450.306202:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140993408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790100450.306254:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100450.306286:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100450.306449:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140993408 00000100:00100000:1.0:1790100450.306455:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140993408 00000100:00100000:1.0:1790100450.306502:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790100450.306510:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140993408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790100450.306604:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140993408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.306611:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790100450.306645:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140993408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790100450.306739:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1790100450.306793:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260849c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140993536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790100450.306820:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790100450.306877:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100450.314206:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+34:2422:x1877056127312000:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 9750us (9966us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100450.314220:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1790100450.318614:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff92619448d840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100450.318874:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140993536 00000100:00100000:0.0:1790100450.318895:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140993536 00000100:00100000:0.0:1790100450.318962:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790100450.318972:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140993536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790100450.319174:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1877056140993536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (12352us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790100450.319182:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790100450.319328:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260849c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140993536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790100450.319413:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1790100450.319453:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.319463:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.319471:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.319477:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8fc00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100450.319481:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.319489:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.319514:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964200) 00010000:00010000:2.0:1790100450.319518:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790100450.319522:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.319539:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fc00/0xc87a4f2298287631 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100450.319643:0:6516:0:(mdd_object.c:4178:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790100450.319700:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1790100450.319710:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 301607370055ns, next at 302607368298ns, rc = 0 00000001:00080000:2.0:1790100450.319716:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1790100450.319740:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964200) 00010000:00010000:2.0:1790100450.319743:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790100450.319761:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828761c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e34a expref: 35 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.319844:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+34:12217:x1877056127311872:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 33882us (34330us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1790100450.319852:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000020:00080000:2.0:1790100450.319856:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790100450.358290:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100450.358389:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127312128 00000100:00100000:2.0:1790100450.358399:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127312128 00000100:00100000:2.0:1790100450.358448:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:2.0:1790100450.358457:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+34:12217:x1877056127312128:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100450.358478:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100450.358502:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287638 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e351 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.358590:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287638 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e351 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.358606:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287638 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e351 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.358624:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100450.358627:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100450.358631:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926800, rc 0) 00000100:00100000:2.0:1790100450.358688:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12217:x1877056127312128:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 231us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.358695:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:0.0:1790100450.361917:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100450.362000:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127312384 00000100:00100000:3.0:1790100450.362018:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127312384 00000100:00100000:3.0:1790100450.362066:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1790100450.362075:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12217:x1877056127312384:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790100450.362285:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+36:12217:x1877056127312384:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 211us (377us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1790100450.362293:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1790100450.463945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100450.464054:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127312640 00000100:00100000:1.0:1790100450.464064:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127312640 00000100:00100000:1.0:1790100450.464125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1790100450.464135:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+36:12228:x1877056127312640:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100450.464159:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100450.464177:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828763f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e358 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100450.464266:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790100450.464414:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828763f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e358 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.464427:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:1.0:1790100450.464430:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100450.464436:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f229828763f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e358 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.464449:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e000, rc 0) 00000100:00100000:1.0:1790100450.464506:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+37:12228:x1877056127312640:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 373us (569us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1790100450.464514:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:0.0:1790100450.469538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100450.469727:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127312768 00000100:00100000:3.0:1790100450.469737:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127312768 00000100:00100000:3.0:1790100450.469797:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:3.0:1790100450.469807:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+37:12228:x1877056127312768:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1790100450.469876:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.469918:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.469932:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.469945:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.469953:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.469959:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470042:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470050:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470057:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100450.470097:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470108:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470114:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470130:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470136:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100450.470140:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470149:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470160:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:3.0:1790100450.470163:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100450.470167:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470173:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828764d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470186:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470192:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470197:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470202:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100450.470204:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470219:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470227:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1964600) 00010000:00010000:3.0:1790100450.470230:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100450.470233:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470239:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287654 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470249:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470256:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470261:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470266:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100450.470269:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470275:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470281:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100450.470284:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100450.470286:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.470301:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f229828765b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100450.471270:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+37:12228:x1877056127312768:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1460us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100450.471280:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:0.0:1790100450.473470:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100450.473615:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127313024 00000100:00100000:3.0:1790100450.473624:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127313024 00000100:00100000:3.0:1790100450.473783:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1790100450.473793:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+37:12228:x1877056127313024:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790100450.474022:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+38:12228:x1877056127313024:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 230us (558us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1790100450.474030:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1790100450.505380:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100450.505468:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127313280 00000100:00100000:1.0:1790100450.505477:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127313280 00000100:00100000:1.0:1790100450.505538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:1.0:1790100450.505549:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+38:12231:x1877056127313280:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100450.505571:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100450.505591:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287662 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e35f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505673:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505688:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505698:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505709:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505716:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505723:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505822:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505845:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505853:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100450.505863:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790100450.505935:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.505943:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506075:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506080:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ee00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100450.506084:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506092:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506104:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100450.506107:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100450.506111:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506117:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298287669 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506132:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506144:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506150:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506156:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ea00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100450.506159:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506165:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506172:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1964600) 00010000:00010000:1.0:1790100450.506175:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100450.506178:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506184:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287670 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506221:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e000/0xc87a4f2298287662 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506235:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.506242:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100450.506245:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100450.506253:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8fa00, rc 0) 00000100:00100000:1.0:1790100450.506387:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+40:12231:x1877056127313280:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 839us (1055us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1790100450.506395:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:0.0:1790100450.509613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100450.509958:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127313408 00000100:00100000:2.0:1790100450.509967:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127313408 00000100:00100000:2.0:1790100450.510065:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:2.0:1790100450.510076:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+40:12231:x1877056127313408:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790100450.510139:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510155:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510166:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510198:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510222:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510229:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510235:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100450.510239:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510246:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510258:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100450.510260:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100450.510265:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.510271:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287685 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.510383:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+40:12231:x1877056127313408:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 308us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.510390:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:0.0:1790100450.512919:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100450.513065:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127313664 00000100:00100000:3.0:1790100450.513074:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127313664 00000100:00100000:3.0:1790100450.513128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1790100450.513139:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+40:12231:x1877056127313664:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790100450.513361:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+41:12231:x1877056127313664:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 199us (436us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1790100450.513369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1790100450.760777:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100450.760801:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92619123bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140993664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100450.760867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100450.761382:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140993792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100450.761408:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100450.761521:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140993664 00000100:00100000:3.0:1790100450.761528:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140993664 00000100:00100000:3.0:1790100450.761592:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140993792 00000100:00100000:3.0:1790100450.761596:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140993792 00000100:00100000:3.0:1790100450.761614:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790100450.761622:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140993664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100450.761650:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790100450.761696:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056140993664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100450.761713:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790100450.761730:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790100450.761737:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140993792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100450.761747:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790100450.761774:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140993792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100450.761779:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1790100450.761795:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100450.761826:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140993792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100450.761841:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92619123bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056140993664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100450.786134:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100450.786221:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127313920 00000100:00100000:2.0:1790100450.786230:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127313920 00000100:00100000:2.0:1790100450.786291:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:2.0:1790100450.786301:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+41:12262:x1877056127313920:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790100450.786323:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100450.786363:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828768c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e366 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.786457:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287693 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.786471:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.786483:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100450.786494:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790100450.786599:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828768c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e366 expref: 44 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.786616:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287693 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e366 expref: 43 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.786625:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100450.786628:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100450.786631:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926a00, rc 0) 00000100:00100000:2.0:1790100450.786688:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+43:12262:x1877056127313920:12345-192.168.203.13@tcp:101:cat.0 Request processed in 389us (563us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1790100450.786709:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:0.0:1790100450.790899:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100450.790953:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100450.791087:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127314176 00000100:00100000:3.0:1790100450.791095:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127314176 00000100:00100000:3.0:1790100450.791150:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1790100450.791158:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+43:12262:x1877056127314176:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:3.0:1790100450.791393:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+44:12262:x1877056127314176:12345-192.168.203.13@tcp:35:cat.0 Request processed in 235us (500us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1790100450.791400:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1790100450.791696:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127314304 00000100:00100000:1.0:1790100450.791701:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127314304 00000100:00100000:1.0:1790100450.791747:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1790100450.791755:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+44:2422:x1877056127314304:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100450.791765:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100450.791787:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287693 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e366 expref: 44 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.791802:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100450.791807:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100450.791835:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+43:2422:x1877056127314304:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 81us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.791842:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1790100450.836499:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100450.836581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127314560 00000100:00100000:3.0:1790100450.836590:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127314560 00000100:00100000:3.0:1790100450.836646:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:3.0:1790100450.836655:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+43:12268:x1877056127314560:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:3.0:1790100450.836677:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100450.836680:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790100450.836703:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982875f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e33c expref: 43 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.836732:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:3.0:1790100450.836737:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100450.836750:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e36d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.836844:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.836858:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.836866:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.836902:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.836915:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 43 pid: 6514 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100450.836928:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140993920:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100450.837038:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f480 going to sleep for 11 seconds 00000100:00100000:1.0:1790100450.840030:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100450.840137:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127314688 00000100:00100000:2.0:1790100450.840143:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127314688 00010000:00010000:2.0:1790100450.840168:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 44 pid: 6514 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.840208:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:2.0:1790100450.840216:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184255050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+44:2422:x1877056127314688:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100450.840227:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100450.840232:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 44 pid: 6514 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.840244:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 44 pid: 6514 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.840260:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100450.840265:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.840273:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.840281:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.840298:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100450.840368:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184255050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+44:2422:x1877056127314688:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 152us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.840388:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00010000:00010000:3.0:1790100450.840806:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f2298287677 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e35f expref: 43 pid: 6514 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100450.840822:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140993920:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100450.840848:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.840857:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.840863:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100450.840888:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790100450.841001:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.841026:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.841034:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100450.841037:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100450.841039:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031e00, rc 0) 00000100:00100000:3.0:1790100450.841147:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+43:12268:x1877056127314560:12345-192.168.203.13@tcp:101:dd.0 Request processed in 4492us (4655us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1790100450.841154:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:1.0:1790100450.844222:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100450.844311:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127314816 00000100:00100000:2.0:1790100450.844318:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127314816 00000100:00100000:2.0:1790100450.844446:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:2.0:1790100450.844456:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+43:12268:x1877056127314816:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1790100450.844475:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100450.844490:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982876b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e374 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.844517:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.844530:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.844539:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.844690:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f22982876b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 45 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.844705:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 44 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.844713:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100450.844716:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100450.844719:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927200, rc 0) 00000100:00100000:2.0:1790100450.844804:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+44:12268:x1877056127314816:12345-192.168.203.13@tcp:101:dd.0 Request processed in 349us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.844818:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:0.0:1790100450.848796:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100450.848963:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127315072 00000100:00100000:1.0:1790100450.848970:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127315072 00000100:00100000:1.0:1790100450.849024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:1.0:1790100450.849033:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+44:12268:x1877056127315072:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:1.0:1790100450.849202:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.849218:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.849236:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100450.849276:0:6514:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1790100450.849299:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b9e2f6d reply state 00000000d6cf70e5 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.849311:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.849319:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100450.849322:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100450.849325:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790100450.849415:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+47:12268:x1877056127315072:12345-192.168.203.13@tcp:36:dd.0 Request processed in 383us (626us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1790100450.849422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000020:00080000:1.0:1790100450.849426:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100451.144886:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100451.502236:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100451.502315:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127315200 00000100:00100000:1.0:1790100451.502324:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127315200 00000100:00100000:1.0:1790100451.502469:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:1.0:1790100451.502480:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619123bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+47:12282:x1877056127315200:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:1.0:1790100451.502501:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100451.502520:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e600/0xc87a4f22982876cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e37b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502604:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502618:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502634:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502645:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502653:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502659:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502716:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502726:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502735:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502763:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.502776:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 48 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100451.502788:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260849c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140994048:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100451.503102:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff92619448dd80 going to sleep for 11 seconds 00000100:00080000:2.0:1790100451.503466:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100451.506134:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260849c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140994048:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100451.506159:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100451.510391:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100451.510691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127315456 00000100:00100000:3.0:1790100451.510701:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127315456 00000100:00100000:3.0:1790100451.510753:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1790100451.510763:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+49:6182:x1877056127315456:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790100451.511253:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+50:6182:x1877056127315456:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 489us (869us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1790100451.511275:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1790100451.513400:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100451.513468:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127315584 00000100:00100000:1.0:1790100451.513475:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127315584 00010000:00010000:1.0:1790100451.513503:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 50 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100451.513538:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1790100451.513553:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+50:2421:x1877056127315584:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100451.513566:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100451.513572:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 50 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.513583:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 50 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.513603:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e36d expref: 50 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.513619:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100451.513624:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.513633:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.513641:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.513679:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100451.513716:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+49:2421:x1877056127315584:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 170us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100451.513723:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00010000:00010000:3.0:1790100451.514376:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514385:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100451.514428:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790100451.514431:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100451.514449:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514462:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514470:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514478:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514485:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514491:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100451.514494:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514501:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514510:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:3.0:1790100451.514517:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100451.514522:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514528:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982876d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514540:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514557:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514564:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514568:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8fa00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100451.514571:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514577:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514584:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1964600) 00010000:00010000:3.0:1790100451.514586:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100451.514589:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514595:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982876d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514622:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e600/0xc87a4f22982876cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e37b expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514646:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e37b expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.514654:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100451.514656:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100451.514658:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8ee00, rc 0) 00000100:00100000:3.0:1790100451.514690:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619123bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+48:12282:x1877056127315200:12345-192.168.203.13@tcp:101:stat.0 Request processed in 12212us (12866us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100451.514696:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:0.0:1790100451.724764:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100451.724943:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127315840 00000100:00100000:3.0:1790100451.724953:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127315840 00000100:00100000:3.0:1790100451.725018:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:3.0:1790100451.725027:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+48:12288:x1877056127315840:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:3.0:1790100451.725092:0:9338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100451.725117:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f22982876e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e37b expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.725134:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100451.725139:0:9338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100451.725291:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.725306:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.725315:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100451.725398:0:9338:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1790100451.725416:0:9338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c91e868b reply state 000000008ea1e9ab transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.725427:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.725434:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100451.725437:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790100451.725439:0:9338:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100451.725514:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+50:12288:x1877056127315840:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 487us (758us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1790100451.725521:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000020:00080000:3.0:1790100451.725525:0:9338:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790100451.791482:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140994176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100451.791553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100451.791697:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140994176 00000100:00100000:1.0:1790100451.791705:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140994176 00000100:00100000:1.0:1790100451.791761:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790100451.791772:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140994176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790100451.791804:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1790100451.791857:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140994176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100451.791865:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790100451.791961:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140994176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100451.929331:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100451.929444:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127315968 00000100:00100000:3.0:1790100451.929453:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127315968 00000100:00100000:3.0:1790100451.929513:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:3.0:1790100451.929523:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+50:12302:x1877056127315968:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:3.0:1790100451.929543:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100451.929561:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982876ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e382 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929628:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929641:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929671:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929683:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929691:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929697:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929756:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929764:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929771:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100451.929808:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1790100451.929812:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100451.929828:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929839:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929847:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929863:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929869:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929875:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100451.929879:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929887:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929898:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:3.0:1790100451.929901:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100451.929905:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929911:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982876f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929925:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929931:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929950:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929955:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100451.929964:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929970:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929979:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1964600) 00010000:00010000:3.0:1790100451.929981:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100451.929984:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.929991:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f22982876fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.930035:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982876ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.930049:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.930056:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100451.930058:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100451.930061:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031c00, rc 0) 00000100:00100000:3.0:1790100451.930126:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+51:12302:x1877056127315968:12345-192.168.203.13@tcp:101:stat.0 Request processed in 605us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100451.930134:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:0.0:1790100452.048291:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100452.048440:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127316224 00000100:00100000:3.0:1790100452.048450:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127316224 00000100:00100000:3.0:1790100452.048553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:3.0:1790100452.048563:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+51:12312:x1877056127316224:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100452.048596:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100452.048614:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828770a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e389 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100452.048734:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790100452.048876:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828770a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e389 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.048892:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:3.0:1790100452.048896:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100452.048901:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828770a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e389 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.048916:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031800, rc 0) 00000100:00100000:3.0:1790100452.050149:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+52:12312:x1877056127316224:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1585us (1864us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1790100452.050157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000001:00080000:0.0:1790100452.053244:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:0.0:1790100452.053281:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790100452.053308:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff926184ed3000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790100452.053313:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083b92600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff926184ed3d80 00000020:00080000:0.0:1790100452.053316:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083b92300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff926084801000 00000100:00100000:2.0:1790100452.053478:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140994304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790100452.053530:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790100452.054313:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1790100452.054373:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1790100452.054439:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054452:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054459:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054466:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100452.054470:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054478:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054505:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff926183194600) 00010000:00010000:1.0:1790100452.054508:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.054513:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054520:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828757b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054539:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054545:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054551:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054555:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100452.054559:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054565:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054571:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100452.054574:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.054576:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054581:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287582 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054602:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054608:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054614:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054620:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100452.054623:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054628:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054636:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1964600) 00010000:00010000:1.0:1790100452.054638:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.054641:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054647:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f22982875c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054658:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054663:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054669:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054678:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100452.054681:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054687:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054693:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100452.054695:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.054796:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054804:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f22982876c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054816:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054822:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054829:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054834:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100452.054838:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054843:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054862:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100452.054864:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.054867:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.054873:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982876e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.055075:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140994304 00000100:00100000:3.0:1790100452.055083:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140994304 00000100:00080000:2.0:1790100452.055229:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100452.055292:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790100452.055302:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1877056140994304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790100452.055329:0:10090:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1790100452.055389:0:10090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6ab2c3e1, atime: 0x6ab2c3e1, ctime: 0x6ab2c3e1, blocks: 0x8 00010000:00010000:3.0:1790100452.055397:0:10090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.055410:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1790100452.055419:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100452.055426:0:10090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.055440:0:10090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.055450:0:10090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.055457:0:10090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.055472:0:10090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790100452.055588:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1877056140994304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 288us (2057us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790100452.055595:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1790100452.059278:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100452.059290:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.059304:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030c00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100452.059309:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.059320:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.059374:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.059383:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084f917e0/0xc87a4f2298287718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.059407:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100452.059409:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100452.059410:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790100452.059503:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9260848c0a80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1790100452.059511:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056140994304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790100452.065742:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100452.065856:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127316480 00000100:00100000:2.0:1790100452.065865:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127316480 00000100:00100000:2.0:1790100452.065920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790100452.065930:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+17:12312:x1877056127316480:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790100452.066160:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:12312:x1877056127316480:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 230us (424us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1790100452.066168:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1790100452.120523:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100452.120610:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127316736 00000100:00100000:0.0:1790100452.120628:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127316736 00000100:00100000:0.0:1790100452.120693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:0.0:1790100452.121290:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+18:12318:x1877056127316736:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790100452.121314:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100452.121333:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828771f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e390 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.121492:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.121509:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.121518:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.121553:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.121569:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 19 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100452.121583:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084819880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877056140994432:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100452.121783:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100452.127243:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100452.127782:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084819880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877056140994432:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100452.127806:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100452.127914:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127316864 00000100:00100000:2.0:1790100452.127922:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127316864 00010000:00010000:2.0:1790100452.127964:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 20 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100452.128008:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:2.0:1790100452.128018:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+20:2421:x1877056127316864:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100452.128032:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100452.128052:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 20 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.128064:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 20 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.128086:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f2298287703 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e382 expref: 20 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.128103:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100452.128107:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.128117:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.128124:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.128153:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100452.128203:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+19:2421:x1877056127316864:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 185us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.128210:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00010000:00010000:1.0:1790100452.128670:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.128679:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100452.128697:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1790100452.128821:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828771f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.128837:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.128844:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100452.128847:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100452.128850:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46c00, rc 0) 00000100:00100000:1.0:1790100452.128883:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+19:12318:x1877056127316736:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8181us (8370us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1790100452.128899:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:1.0:1790100452.132488:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100452.132626:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127317120 00000100:00100000:0.0:1790100452.132645:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127317120 00000100:00100000:0.0:1790100452.132730:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:0.0:1790100452.132741:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+19:12318:x1877056127317120:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:0.0:1790100452.133038:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.133054:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.133064:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100452.133100:0:12139:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1790100452.133120:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006050485f reply state 000000002dd2013a transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.133132:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.133139:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:0.0:1790100452.133142:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790100452.133145:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100452.133247:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+22:12318:x1877056127317120:12345-192.168.203.13@tcp:36:bash.0 Request processed in 507us (764us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1790100452.133254:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000020:00080000:0.0:1790100452.133258:0:12139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790100452.140488:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100452.140628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127317248 00000100:00100000:3.0:1790100452.140638:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127317248 00000100:00100000:3.0:1790100452.140730:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:3.0:1790100452.140745:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+22:12318:x1877056127317248:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100452.140770:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100452.140792:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828773b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e397 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.140884:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.140957:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.140968:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.141007:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.141020:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 23 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.141033:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140994560:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100452.141109:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f180 going to sleep for 11 seconds 00000100:00100000:3.0:1790100452.143102:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877056140994560:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100452.143122:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100452.144251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100452.144788:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127317376 00000100:00100000:3.0:1790100452.144795:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127317376 00010000:00010000:3.0:1790100452.144823:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 24 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.144857:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:3.0:1790100452.144866:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+24:2422:x1877056127317376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100452.144877:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100452.144893:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 24 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.144913:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 24 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.145020:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287726 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e390 expref: 24 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.145036:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100452.145041:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.145049:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.145057:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.145081:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100452.145119:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+23:2422:x1877056127317376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 254us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.145127:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00010000:00010000:1.0:1790100452.145868:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.145877:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100452.145945:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790100452.145950:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100452.145969:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.146034:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f229828773b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e397 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.146050:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e397 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.146059:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100452.146062:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100452.146065:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031e00, rc 0) 00000100:00100000:1.0:1790100452.146104:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+22:12318:x1877056127317248:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5361us (5624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.146112:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:1.0:1790100452.148839:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100452.148922:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127317632 00000100:00100000:2.0:1790100452.148935:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127317632 00000100:00100000:2.0:1790100452.148975:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1790100452.148983:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+22:12318:x1877056127317632:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1790100452.149163:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+23:12318:x1877056127317632:12345-192.168.203.13@tcp:35:bash.0 Request processed in 179us (327us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1790100452.149180:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00010000:00010000:2.0:1790100452.168671:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100452.228766:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100452.228951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127317888 00000100:00100000:1.0:1790100452.228961:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127317888 00000100:00100000:1.0:1790100452.229035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:1.0:1790100452.229046:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+23:12328:x1877056127317888:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100452.229068:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100452.229087:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e39e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100452.229177:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790100452.229270:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287749 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e39e expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.229284:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:1.0:1790100452.229288:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100452.229293:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e39e expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.229307:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e800, rc 0) 00000100:00100000:1.0:1790100452.229414:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12328:x1877056127317888:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 369us (656us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1790100452.229422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:1.0:1790100452.237119:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100452.237248:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127318016 00000100:00100000:0.0:1790100452.237259:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127318016 00000100:00100000:0.0:1790100452.237327:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:0.0:1790100452.237378:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12328:x1877056127318016:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1790100452.237468:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237484:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237496:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237511:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237518:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237525:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237611:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237621:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237629:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100452.237676:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237689:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237706:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237713:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237719:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100452.237723:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237730:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237743:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:0.0:1790100452.237746:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100452.237752:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237758:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287757 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237771:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237778:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237784:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237790:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100452.237805:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237812:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237820:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1af1200) 00010000:00010000:0.0:1790100452.237823:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100452.237826:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237833:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828775e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237848:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237855:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237860:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237866:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100452.237869:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237875:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237882:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:0.0:1790100452.237885:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100452.237893:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.237899:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287765 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100452.238495:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12328:x1877056127318016:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1158us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100452.238504:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:0.0:1790100452.241114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100452.241197:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127318272 00000100:00100000:2.0:1790100452.241205:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127318272 00000100:00100000:2.0:1790100452.241278:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1790100452.241288:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12328:x1877056127318272:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790100452.241835:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12328:x1877056127318272:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 547us (724us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1790100452.241843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1790100452.274438:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100452.274614:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127318528 00000100:00100000:1.0:1790100452.274624:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127318528 00000100:00100000:1.0:1790100452.274684:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:1.0:1790100452.274695:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12331:x1877056127318528:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100452.274715:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100452.274745:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f229828776c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3a5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274811:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274825:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274835:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274849:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274856:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274862:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274972:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287781 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274983:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287781 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.274990:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287781 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100452.275008:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790100452.275085:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275102:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275109:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275115:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8fe00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100452.275119:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275131:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275142:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100452.275145:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.275150:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275155:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fe00/0xc87a4f2298287773 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275168:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275174:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275180:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275185:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100452.275193:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275200:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275208:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1964600) 00010000:00010000:1.0:1790100452.275210:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.275213:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275219:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f800/0xc87a4f229828777a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275256:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f229828776c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3a5 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275269:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287781 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3a5 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.275276:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100452.275278:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100452.275281:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f200, rc 0) 00000100:00100000:1.0:1790100452.275385:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12331:x1877056127318528:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 691us (956us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1790100452.275392:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:1.0:1790100452.286985:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100452.287110:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127318656 00000100:00100000:2.0:1790100452.287119:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127318656 00000100:00100000:2.0:1790100452.287181:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1790100452.287190:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+27:2421:x1877056127318656:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100452.287204:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100452.287225:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287781 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3a5 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.287244:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100452.287248:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100452.287311:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+26:2421:x1877056127318656:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 123us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.287318:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1790100452.289652:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100452.289795:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127318784 00000100:00100000:3.0:1790100452.289803:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127318784 00000100:00100000:3.0:1790100452.289856:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:3.0:1790100452.289865:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+26:12331:x1877056127318784:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1790100452.289944:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.289972:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.289983:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.290031:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.290038:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.290044:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.290049:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100452.290053:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.290061:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.290071:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100452.290073:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100452.290077:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.290083:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f229828778f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.290148:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+26:12331:x1877056127318784:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 284us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.290162:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:1.0:1790100452.293126:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100452.293230:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127319040 00000100:00100000:0.0:1790100452.293240:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127319040 00000100:00100000:0.0:1790100452.293320:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1790100452.293330:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+26:12331:x1877056127319040:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1790100452.293564:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12331:x1877056127319040:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 235us (443us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1790100452.293572:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1790100452.296912:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100452.296941:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260848c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140994688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100452.297009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.297124:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140994688 00000100:00100000:2.0:1790100452.297132:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140994688 00000100:00100000:2.0:1790100452.297192:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790100452.297201:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140994688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100452.297232:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100452.297281:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140994688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.297287:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790100452.297426:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260848c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140994688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100452.425917:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100452.426210:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127319296 00000100:00100000:2.0:1790100452.426220:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127319296 00000100:00100000:2.0:1790100452.426282:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:2.0:1790100452.426293:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12349:x1877056127319296:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790100452.426315:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100452.426358:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287796 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3ac expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.426467:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828779d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.426482:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828779d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.426493:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828779d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100452.426504:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790100452.426605:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287796 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ac expref: 30 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.426640:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828779d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ac expref: 29 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.426649:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100452.426653:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790100452.426656:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927800, rc 0) 00000100:00100000:2.0:1790100452.426721:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+29:12349:x1877056127319296:12345-192.168.203.13@tcp:101:cat.0 Request processed in 430us (825us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1790100452.426728:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:1.0:1790100452.449477:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100452.449672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127319424 00000100:00100000:0.0:1790100452.449683:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127319424 00000100:00100000:0.0:1790100452.449744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:0.0:1790100452.449755:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+29:12350:x1877056127319424:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100452.449778:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100452.449796:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982877ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3b3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.449854:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982877b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.449874:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982877b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.449886:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982877b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100452.449927:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790100452.449943:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100452.449961:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982877b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.449986:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f22982877ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3b3 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.450015:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982877b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3b3 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.450024:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:0.0:1790100452.450027:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100452.450031:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:0.0:1790100452.450706:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12350:x1877056127319424:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 950us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100452.450714:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:3.0:1790100452.457389:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100452.457483:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127319808 00000100:00100000:0.0:1790100452.457491:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127319808 00000100:00100000:0.0:1790100452.457555:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1790100452.457565:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12350:x1877056127319808:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1790100452.457819:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+31:12350:x1877056127319808:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 255us (437us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1790100452.457839:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1790100452.462223:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100452.462321:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127319936 00000100:00100000:3.0:1790100452.462330:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127319936 00000100:00100000:3.0:1790100452.462416:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1790100452.462426:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+31:12350:x1877056127319936:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:3.0:1790100452.462440:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790100452.462462:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f2298287742 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e397 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.462483:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f229828779d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ac expref: 30 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.462497:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287638 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e351 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.462507:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100452.462512:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100452.462576:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+28:12350:x1877056127319936:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 152us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.462584:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1790100452.464232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100452.464295:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127320064 00000100:00100000:3.0:1790100452.464302:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127320064 00000100:00100000:3.0:1790100452.464380:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:3.0:1790100452.464389:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+28:12350:x1877056127320064:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:3.0:1790100452.464485:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.464501:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.464513:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790100452.464753:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790100452.464823:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+28:12350:x1877056127320064:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 434us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.464831:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:1.0:1790100452.483984:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100452.484496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127320192 00000100:00100000:3.0:1790100452.484514:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127320192 00000100:00100000:3.0:1790100452.484606:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:3.0:1790100452.484625:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+28:12352:x1877056127320192:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100452.484652:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100452.484677:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982877c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3ba expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.484760:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.484775:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.484792:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.484821:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.484830:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.484838:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485371:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485382:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485390:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100452.485432:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790100452.485437:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100452.485452:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485462:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485469:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485475:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485491:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485497:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100452.485501:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485508:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485520:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:3.0:1790100452.485523:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100452.485528:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485547:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f22982877c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485563:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485568:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485573:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485578:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100452.485581:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485595:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485603:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261900b4100) 00010000:00010000:3.0:1790100452.485606:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100452.485609:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485615:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485647:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982877c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485658:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.485665:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100452.485666:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100452.485668:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030e00, rc 0) 00000100:00100000:3.0:1790100452.485730:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+29:12352:x1877056127320192:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1115us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.485737:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 183 00000040:00080000:1.0:1790100452.745097:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790100452.808700:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140995200:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.808762:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100452.808807:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140995712:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.808832:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100452.808852:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140996224:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.808872:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100452.808900:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1790100452.808906:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140994816:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.808943:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100452.808965:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608481aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140995328:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.808987:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100452.809020:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140995840:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100452.809056:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140996352:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100452.809101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140995200 00000100:00100000:1.0:1790100452.809109:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140995200 00000100:00100000:1.0:1790100452.809163:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1790100452.809172:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140995200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809231:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056140995200:12345-0@lo:400:kworker.0 Request processed in 60us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.809238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1790100452.809269:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140995712 00000100:00100000:1.0:1790100452.809273:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140995712 00000100:00100000:1.0:1790100452.809298:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140996224 00000100:00100000:1.0:1790100452.809300:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140996224 00000100:00100000:1.0:1790100452.809312:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140995840 00000100:00100000:1.0:1790100452.809315:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140995840 00000100:00100000:1.0:1790100452.809326:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140996352 00000100:00100000:1.0:1790100452.809328:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140996352 00000100:00100000:1.0:1790100452.809357:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100452.809363:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140995712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809395:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140995712:12345-0@lo:400:kworker.0 Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.809402:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100452.809413:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790100452.809419:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140996224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809445:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140996224:12345-0@lo:400:kworker.0 Request processed in 26us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.809451:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790100452.809461:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790100452.809466:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140995840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809489:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140995840:12345-0@lo:400:kworker.0 Request processed in 23us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.809495:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790100452.809504:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790100452.809509:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056140996352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809534:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056140996352:12345-0@lo:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.809548:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790100452.809567:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140994816 00000100:00100000:1.0:1790100452.809571:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140994816 00000100:00100000:1.0:1790100452.809751:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1790100452.809759:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140994816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809790:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056140994816:12345-0@lo:400:kworker.0 Request processed in 32us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.809796:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1790100452.809843:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056140994816:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809855:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140995840:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809863:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140996352:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809871:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056140995200:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809879:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140995712:0@lo:400:kworker.0 00000100:00100000:1.0:1790100452.809887:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140996224:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.810175:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140994944:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.810207:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.810277:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140995456:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.810299:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.810317:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140995968:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.810370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.810387:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140996480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100452.810430:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.810469:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790100452.810476:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140995072:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.810497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.810529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140995584:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.810550:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.810575:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140996096:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.810807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.810817:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100452.810825:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140996608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100452.810843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100452.810885:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140995328 00000100:00100000:2.0:1790100452.810890:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140995328 00000100:00100000:2.0:1790100452.810917:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140995072 00000100:00100000:2.0:1790100452.810920:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140995072 00000100:00100000:0.0:1790100452.811018:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140996480 00000100:00100000:0.0:1790100452.811023:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140996480 00000100:00100000:0.0:1790100452.811045:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140996608 00000100:00100000:0.0:1790100452.811048:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140996608 00000100:00100000:0.0:1790100452.811061:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790100452.811068:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1877056140996480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100452.811089:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100452.811140:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1877056140996480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100452.811146:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790100452.811159:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790100452.811165:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140996608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100452.811174:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100452.811197:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140996608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100452.811203:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790100452.811326:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790100452.811333:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140995328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.811401:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056140995328:12345-0@lo:400:kworker.0 Request processed in 67us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.811407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790100452.811421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790100452.811427:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140995072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.811454:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056140995072:12345-0@lo:400:kworker.0 Request processed in 28us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.811460:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790100452.811476:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140994944 00000100:00100000:2.0:1790100452.811480:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140994944 00000100:00100000:2.0:1790100452.811495:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140995456 00000100:00100000:2.0:1790100452.811497:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140995456 00000100:00100000:2.0:1790100452.811509:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140995968 00000100:00100000:2.0:1790100452.811511:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140995968 00000100:00100000:2.0:1790100452.811521:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140995584 00000100:00100000:2.0:1790100452.811523:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140995584 00000100:00100000:2.0:1790100452.811533:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140996096 00000100:00100000:2.0:1790100452.811535:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140996096 00000100:00100000:2.0:1790100452.811549:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790100452.811563:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140994944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.811660:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056140994944:12345-0@lo:400:kworker.0 Request processed in 97us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.811667:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790100452.811680:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790100452.811686:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140995456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.811713:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056140995456:12345-0@lo:400:kworker.0 Request processed in 28us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.811719:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790100452.811729:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790100452.811735:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140995968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.811759:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056140995968:12345-0@lo:400:kworker.0 Request processed in 25us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.811765:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790100452.811776:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790100452.811781:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140995584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.811805:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056140995584:12345-0@lo:400:kworker.0 Request processed in 24us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.811810:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790100452.811820:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790100452.811825:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140996096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.811848:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056140996096:12345-0@lo:400:kworker.0 Request processed in 23us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.811853:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:2.0:1790100452.811868:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100452.811877:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100452.811880:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100452.811882:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100452.812093:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140996608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100452.812108:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056140995072:0@lo:400:kworker.0 00010000:00080000:2.0:1790100452.812196:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926084835180 x1877056140995584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100452.812206:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056140995584:0@lo:400:kworker.0 00010000:00080000:2.0:1790100452.812272:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926084837100 x1877056140996096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100452.812286:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056140996096:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.812298:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056140994944:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.812315:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056140995456:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.812324:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056140995968:0@lo:400:kworker.0 00000100:00100000:2.0:1790100452.812433:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140996480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100452.812540:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608481aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056140995328:0@lo:400:kworker.0 00000040:00080000:2.0:1790100453.000475:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100453.000484:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100453.000578:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790100453.000586:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100453.000712:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926191238700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140996736:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790100453.000799:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100453.010527:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100453.010676:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127320320 00000100:00100000:0.0:1790100453.010686:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127320320 00000100:00100000:0.0:1790100453.010783:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:0.0:1790100453.010793:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12363:x1877056127320320:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790100453.010822:0:12139:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790100453.010947:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12363:x1877056127320320:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 155us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100453.010963:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:2.0:1790100453.011128:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926191238700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140996736:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1790100453.013881:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100453.014054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100453.014141:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127320448 00000100:00100000:2.0:1790100453.014155:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127320448 00000100:00100000:2.0:1790100453.014233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:2.0:1790100453.014243:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+29:12363:x1877056127320448:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790100453.014308:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014333:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014376:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014393:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014401:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014407:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014432:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014439:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014446:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100453.014484:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790100453.014488:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100453.014506:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014517:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014523:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014530:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014618:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100453.014623:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014631:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014643:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:2.0:1790100453.014645:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100453.014650:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014655:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f22982877dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014666:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014672:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014677:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014688:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100453.014690:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014696:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014703:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff926183194a00) 00010000:00010000:2.0:1790100453.014705:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100453.014707:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014712:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f22982877e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014726:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014732:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014739:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014744:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100453.014747:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014752:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014769:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100453.014771:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100453.014774:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.014779:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982877ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100453.014878:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+29:12363:x1877056127320448:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 636us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100453.014885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:0.0:1790100453.017125:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.017208:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127320704 00000100:00100000:3.0:1790100453.017217:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127320704 00000100:00100000:3.0:1790100453.017294:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:3.0:1790100453.017314:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+29:12363:x1877056127320704:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.017331:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100453.017378:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982877f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017485:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017499:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017509:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100453.017520:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790100453.017603:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017610:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017617:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017622:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180031c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100453.017626:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017633:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017643:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100453.017651:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100453.017656:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017663:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031c00/0xc87a4f22982877f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017704:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982877f1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3c1 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017715:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:3.0:1790100453.017717:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100453.017721:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031e00/0xc87a4f22982877f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3c1 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.017730:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180031e00, rc 0) 00000100:00100000:3.0:1790100453.017787:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12363:x1877056127320704:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 473us (669us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1790100453.017794:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:0.0:1790100453.022256:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100453.022331:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127320832 00000100:00100000:2.0:1790100453.022364:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127320832 00000100:00100000:2.0:1790100453.022414:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:2.0:1790100453.022424:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12363:x1877056127320832:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790100453.022458:0:9338:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790100453.022581:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12363:x1877056127320832:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 157us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100453.022588:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:2.0:1790100453.025608:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.025802:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127321088 00000100:00100000:3.0:1790100453.025810:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127321088 00000100:00100000:3.0:1790100453.025865:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1790100453.025875:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12363:x1877056127321088:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.025891:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100453.025895:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790100453.025937:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f22982877b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3b3 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.025954:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:3.0:1790100453.025972:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100453.025986:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f2298287806 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3c8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100453.026471:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790100453.026610:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828780d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026623:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828780d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026633:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828780d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026679:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180031800/0xc87a4f2298287806 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3c8 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026704:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828780d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3c8 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026712:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:3.0:1790100453.026716:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100453.026718:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926180030c00, rc 0) 00000100:00100000:3.0:1790100453.026817:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+31:12363:x1877056127321088:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 943us (1216us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1790100453.026825:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:0.0:1790100453.031495:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.031629:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127321344 00000100:00100000:3.0:1790100453.031639:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127321344 00000100:00100000:3.0:1790100453.031722:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:3.0:1790100453.031742:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+31:12363:x1877056127321344:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.031804:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100453.031831:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030c00/0xc87a4f229828780d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3c8 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.031847:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:3.0:1790100453.031857:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100453.031877:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.031890:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032050:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032071:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032079:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032087:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032134:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032142:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032148:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032160:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100453.032165:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032173:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032182:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:3.0:1790100453.032185:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100453.032188:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032194:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a2e58c00/0xc87a4f229828781b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032203:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032209:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032215:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032220:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100453.032223:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032229:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032245:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd57a8f33 (ffff9261900b4f00) 00010000:00010000:3.0:1790100453.032247:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100453.032250:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.032256:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287822 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd57a8f33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.032404:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12363:x1877056127321344:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 673us (915us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790100453.032412:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:0.0:1790100453.039681:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100453.039756:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127321472 00000100:00100000:2.0:1790100453.039765:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127321472 00000100:00100000:2.0:1790100453.039853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:2.0:1790100453.039863:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12363:x1877056127321472:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100453.039882:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100453.039900:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287829 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3cf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.039954:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.039967:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.039979:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.040086:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287829 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.040103:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.040112:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:2.0:1790100453.040115:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100453.040118:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926600, rc 0) 00000100:00100000:2.0:1790100453.040176:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+31:12363:x1877056127321472:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 315us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100453.040183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:1.0:1790100453.044529:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100453.055499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127321728 00000100:00100000:0.0:1790100453.055512:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127321728 00000100:00100000:0.0:1790100453.055664:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:0.0:1790100453.055675:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+31:12363:x1877056127321728:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100453.055756:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.055773:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.055784:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100453.056012:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1790100453.056022:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 304343681960ns, next at 305343679697ns, rc = 0 00000004:00010000:0.0:1790100453.056065:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d452ca3 reply state 00000000331489c5 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.056078:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.056085:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:0.0:1790100453.056095:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790100453.056100:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100453.056189:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+33:12363:x1877056127321728:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 516us (11668us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790100453.056197:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:0.0:1790100453.058026:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.058094:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127321856 00000100:00100000:3.0:1790100453.058101:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127321856 00000100:00100000:3.0:1790100453.058140:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:3.0:1790100453.058149:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+33:12363:x1877056127321856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.058166:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100453.058180:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.058221:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.058234:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.058249:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:3.0:1790100453.058252:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100453.058262:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6400, rc 0) 00000100:00100000:3.0:1790100453.058331:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+34:12363:x1877056127321856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 183us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.058364:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:0.0:1790100453.067628:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100453.067810:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127321984 00000100:00100000:1.0:1790100453.067819:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127321984 00000100:00100000:1.0:1790100453.067890:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1790100453.067900:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127321984:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790100453.068126:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127321984:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 227us (508us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790100453.068132:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00080000:2.0:1790100453.068512:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100453.072611:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.072799:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127322240 00000100:00100000:3.0:1790100453.072808:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127322240 00000100:00100000:3.0:1790100453.072857:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1790100453.072865:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+34:12363:x1877056127322240:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100453.073196:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12363:x1877056127322240:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 331us (594us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1790100453.073203:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1790100453.076071:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100453.076144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127322496 00000100:00100000:2.0:1790100453.076152:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127322496 00000100:00100000:2.0:1790100453.076206:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:2.0:1790100453.076214:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12363:x1877056127322496:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100453.076303:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12363:x1877056127322496:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100453.076321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:0.0:1790100453.080654:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.080909:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127322624 00000100:00100000:3.0:1790100453.080918:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127322624 00000100:00100000:3.0:1790100453.080975:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:3.0:1790100453.080985:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12363:x1877056127322624:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.081011:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100453.081030:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287845 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3dd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.081109:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f229828784c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.081122:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f229828784c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.081133:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f229828784c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100453.081182:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100453.081200:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f229828784c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.081222:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287845 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3dd expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.081238:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f229828784c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3dd expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.081246:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:3.0:1790100453.081250:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790100453.081253:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7800, rc 0) 00000100:00100000:3.0:1790100453.081467:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+36:12363:x1877056127322624:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 482us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.081475:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:0.0:1790100453.101675:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.111336:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127322752 00000100:00100000:3.0:1790100453.111510:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127322752 00000100:00100000:0.0:1790100453.111674:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1790100453.111695:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2421:x1877056127322752:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100453.111713:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100453.111732:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3e4 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100453.111755:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c3e4, blocks: 0x0 00010000:00010000:0.0:1790100453.111773:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=304s v=(0 0) 00010000:00010000:0.0:1790100453.111777:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100453.111796:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.111814:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.111827:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46800, rc 0) 00000100:00100000:0.0:1790100453.111882:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127322752:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 190us (10216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100453.111897:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1790100453.126067:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.130106:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127323008 00000100:00100000:3.0:1790100453.130117:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127323008 00000100:00100000:2.0:1790100453.130224:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:2.0:1790100453.130234:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+36:12363:x1877056127323008:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100453.130326:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+36:12363:x1877056127323008:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 93us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100453.130333:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:0.0:1790100453.139160:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.140881:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127323136 00000100:00100000:3.0:1790100453.140892:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127323136 00000100:00100000:3.0:1790100453.140958:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1790100453.140969:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:12363:x1877056127323136:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.140985:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100453.141018:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3eb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.141062:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.141072:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100453.141077:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100453.141082:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.141115:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.141129:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 9 pid: 8427 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.141143:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140996864:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100453.141221:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261933bce40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100453.150585:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100453.150620:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127323264 00000100:00100000:0.0:1790100453.150628:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127323264 00010000:00010000:0.0:1790100453.150662:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 10 pid: 8427 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.150703:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1790100453.150711:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2421:x1877056127323264:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100453.150722:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100453.150740:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 10 pid: 8427 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.150752:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 10 pid: 8427 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.150773:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100453.150777:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100453.150918:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.150936:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.150979:0:9513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.151002:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9513:1877056140996992:192.168.203.13@tcp:105: 00000100:00100000:0.0:1790100453.151075:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8c00 going to sleep for 11 seconds 00010000:00010000:3.0:1790100453.151710:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000223a7831/0xc87a4f2298287853 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3e4 expref: 10 pid: 8427 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.151725:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140996864:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100453.151744:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.151753:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7e00, rc 0) 00000100:00100000:3.0:1790100453.151915:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:12363:x1877056127323136:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 10947us (12762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.151930:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1790100453.167137:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100453.167174:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127323392 00000100:00100000:1.0:1790100453.167183:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127323392 00002000:00100000:1.0:1790100453.167223:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff926083bec700 x1877056127323392/t0(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:749/0 lens 504/0 e 0 to 0 dl 1790100464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100453.167233:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926083bec700 with x1877056127323392 ext(0->8) 00002000:00010000:1.0:1790100453.167238:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926083bec700 00000100:00100000:1.0:1790100453.167259:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1790100453.167266:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2421:x1877056127323392:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790100453.168274:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2421:x1877056127323392:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 1006us (1143us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1790100453.168282:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00002000:00100000:1.0:1790100453.168289:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff926083bec700 x1877056127323392/t4294967315(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:749/0 lens 504/448 e 0 to 0 dl 1790100464 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100453.168298:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926083bec700 with x1877056127323392 ext(0->8) 00002000:00010000:1.0:1790100453.168301:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926083bec700 00000100:00100000:3.0:1790100453.170401:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9513:1877056140996992:192.168.203.13@tcp:105: 00010000:00010000:3.0:1790100453.170422:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100453.170459:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2421:x1877056127323264:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 19749us (19881us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.170468:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1790100453.181724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.181878:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127323520 00000100:00100000:3.0:1790100453.181887:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127323520 00000100:00100000:3.0:1790100453.182587:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:3.0:1790100453.182600:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+36:12363:x1877056127323520:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790100453.189640:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1790100453.189655:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1790100453.189701:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:3.0:1790100453.189728:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189738:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189746:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189752:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100453.189756:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189763:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189784:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100453.189787:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100453.189792:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189797:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287734 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189813:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189819:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189824:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189829:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100453.189831:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189837:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189844:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:3.0:1790100453.189847:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790100453.189850:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.189855:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287837 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790100453.189972:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1790100453.189982:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790100453.190099:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+19:12363:x1877056127323520:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 7498us (8380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.190109:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:2.0:1790100453.190233:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100453.190248:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140997120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790100453.190297:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100453.190369:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140997120 00000100:00100000:2.0:1790100453.190377:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140997120 00000100:00100000:2.0:1790100453.190414:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790100453.190423:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b2572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140997120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790100453.190532:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790100453.190535:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790100452 00002000:00010000:2.0:1790100453.190538:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790100453.190540:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790100452 -> 1790100452 00002000:00010000:2.0:1790100453.190542:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1790100453.190574:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b2572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1877056140997120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (277us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790100453.190581:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1790100453.190620:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92608492ed80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1790100453.190625:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140997120:0@lo:2:osp-syn-0-0.0 00000040:00080000:2.0:1790100453.195217:0:14691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100453.195229:0:14691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100453.195252:0:14691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790100453.195259:0:14691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790100453.195501:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100453.196818:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.196942:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127323648 00000100:00100000:3.0:1790100453.196951:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127323648 00000100:00100000:3.0:1790100453.197008:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1790100453.197018:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2421:x1877056127323648:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790100453.198736:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1790100453.198746:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1790100453.198876:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2421:x1877056127323648:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 1858us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.198885:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1790100453.201131:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.201206:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127323904 00000100:00100000:3.0:1790100453.201214:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127323904 00000100:00100000:3.0:1790100453.201264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:3.0:1790100453.201273:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+19:12363:x1877056127323904:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.201318:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100453.201369:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f229828784c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3dd expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.201386:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:3.0:1790100453.201392:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100453.201419:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.201442:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.201453:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100453.201567:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c2efed4 reply state 00000000954ba5f3 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.201580:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.201586:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:3.0:1790100453.201588:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790100453.201591:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100453.201662:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+20:12363:x1877056127323904:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 389us (535us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1790100453.201669:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:1.0:1790100453.203803:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100453.203899:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127324032 00000100:00100000:2.0:1790100453.203915:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127324032 00000100:00100000:2.0:1790100453.204055:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1790100453.204064:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2421:x1877056127324032:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790100453.204177:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790100453.204181:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790100452 -> 1790100451 00002000:00010000:2.0:1790100453.204183:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790100449 00002000:00010000:2.0:1790100453.204186:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790100452 -> 1790100451 00002000:00010000:2.0:1790100453.204188:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790100453.204265:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127324032:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 202us (466us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790100453.204272:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1790100453.212418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.212568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127324288 00000100:00100000:3.0:1790100453.212578:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127324288 00000100:00100000:3.0:1790100453.212638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:3.0:1790100453.212649:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+20:12363:x1877056127324288:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.212721:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.212738:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.212747:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.212786:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.212799:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 20 pid: 6514 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.212814:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877056140997248:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100453.212888:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261933bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790100453.216794:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100453.216861:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127324416 00000100:00100000:0.0:1790100453.216869:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127324416 00010000:00010000:0.0:1790100453.216909:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 21 pid: 6514 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.216945:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:0.0:1790100453.216956:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184254c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+21:2421:x1877056127324416:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100453.216968:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100453.216974:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 21 pid: 6514 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.216999:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 21 pid: 6514 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.217021:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:0.0:1790100453.217026:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.217035:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.217051:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.217068:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100453.217117:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184254c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+21:2421:x1877056127324416:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 163us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100453.217124:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00010000:00010000:3.0:1790100453.217574:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287830 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3cf expref: 20 pid: 6514 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.217591:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877056140997248:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100453.217609:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217618:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217625:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217660:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217668:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217675:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217688:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100453.217692:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217700:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217710:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:3.0:1790100453.217712:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790100453.217716:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.217722:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287868 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.217775:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+19:12363:x1877056127324288:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 5127us (5363us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790100453.217783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:1.0:1790100453.220702:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.220759:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127324544 00000100:00100000:3.0:1790100453.220766:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127324544 00000100:00100000:3.0:1790100453.220813:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1790100453.220822:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127324544:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.220859:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.220878:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.220909:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100453.220914:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100453.220919:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.220950:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.220964:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 8 pid: 8425 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.220978:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140997376:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100453.221056:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261933bca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790100453.240514:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056140997376:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100453.240552:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100453.255480:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.258646:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127324672 00000100:00100000:3.0:1790100453.258662:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127324672 00010000:00010000:3.0:1790100453.258820:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 9 pid: 8425 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.258899:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:3.0:1790100453.258920:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2422:x1877056127324672:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100453.259858:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100453.259880:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 9 pid: 8425 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.259896:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 9 pid: 8425 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.259996:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea1fd7e/0xc87a4f229828785a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3eb expref: 9 pid: 8425 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.260011:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100453.260016:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100453.260020:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.260029:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.260063:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100453.260120:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127324672:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1202us (4648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.260129:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00010000:00010000:1.0:1790100453.260187:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.260198:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.260218:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.260226:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.260235:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.260242:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100453.260246:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.260254:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.260266:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.260274:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f229828786f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100453.260333:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127324544:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 39512us (39638us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100453.260361:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:1.0:1790100453.274094:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.274363:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127324928 00000100:00100000:3.0:1790100453.274373:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127324928 00000100:00100000:3.0:1790100453.274427:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:3.0:1790100453.274438:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+19:12363:x1877056127324928:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790100453.274522:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.274553:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 19 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.274563:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.274596:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 19 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.274610:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 19 pid: 9338 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.274625:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140997504:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100453.274907:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261933bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790100453.278276:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100453.278306:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127325056 00000100:00100000:1.0:1790100453.278314:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127325056 00010000:00010000:1.0:1790100453.278361:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 20 pid: 9338 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100453.278393:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:1.0:1790100453.278402:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+20:2421:x1877056127325056:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100453.278415:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100453.278421:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 20 pid: 9338 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.278434:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 20 pid: 9338 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.278455:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:1.0:1790100453.278460:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.278469:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.278488:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.278508:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100453.278888:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+20:2421:x1877056127325056:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 486us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100453.278897:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00010000:00010000:3.0:1790100453.281829:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982876bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e374 expref: 19 pid: 9338 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.281850:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140997504:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100453.281873:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.281883:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.281888:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.282074:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.282088:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.282096:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.282128:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.282143:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 19 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.282156:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140997632:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100453.282221:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261913b7180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100453.285269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100453.285303:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127325184 00000100:00100000:1.0:1790100453.285311:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127325184 00010000:00010000:1.0:1790100453.285361:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 20 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100453.285392:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:1.0:1790100453.285401:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+20:2421:x1877056127325184:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100453.285414:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100453.285421:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 20 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.285433:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 20 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.285451:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:1.0:1790100453.285457:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.285465:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.285484:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.285500:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100453.285552:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+20:2421:x1877056127325184:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 152us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100453.285559:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00010000:00010000:3.0:1790100453.286629:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828783e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3d6 expref: 19 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.286646:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140997632:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100453.286664:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.286672:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.286983:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100453.287096:0:12139:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1790100453.287191:0:12139:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1790100453.287218:0:12139:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1790100453.287278:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12139:1877056140997760:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1790100453.287320:0:12139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100453.287371:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b5b3a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790100453.288027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140997760 00000100:00100000:1.0:1790100453.288034:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140997760 00000100:00100000:1.0:1790100453.288320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790100453.288330:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12139:x1877056140997760:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1790100453.288439:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12139:x1877056140997760:12345-0@lo:1000:mdt00_004.0 Request processed in 110us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100453.288445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790100453.288481:0:12139:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1790100453.288486:0:12139:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92608492ed80, transno 4294967316 00000100:00100000:1.0:1790100453.288497:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608492c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12139:1877056140997760:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1790100453.289220:0:12139:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1790100453.289266:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084819500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12139:1877056140997888:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1790100453.289311:0:12139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100453.289366:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261913b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1790100453.289656:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140997888 00000100:00100000:2.0:1790100453.289662:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140997888 00000100:00100000:2.0:1790100453.289813:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790100453.289822:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12139:x1877056140997888:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790100453.290134:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12139:x1877056140997888:12345-0@lo:1000:mdt00_004.0 Request processed in 313us (822us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790100453.290142:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790100453.290444:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084819500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12139:1877056140997888:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1790100453.290482:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290491:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290499:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290505:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100453.290509:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290516:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290530:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:3.0:1790100453.290791:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100453.290797:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290804:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f229828787d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290832:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290838:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290844:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290849:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926180030000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100453.290852:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290858:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290865:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100453.290867:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100453.290870:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290876:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030000/0xc87a4f22982877b9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290894:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290907:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.290916:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.291315:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.291329:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 22 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.291366:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140998016:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100453.291427:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194118540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100453.303951:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056140998016:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100453.303983:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.304661:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100453.309657:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127325312 00000100:00100000:3.0:1790100453.309669:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127325312 00010000:00010000:3.0:1790100453.309829:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 23 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.310792:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1790100453.310806:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+23:2421:x1877056127325312:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100453.310820:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100453.310829:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 23 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.310844:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 23 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.310865:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926180030e00/0xc87a4f22982877d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3ba expref: 23 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.310881:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:3.0:1790100453.310892:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.310902:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.310909:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.310949:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100453.311014:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+22:2421:x1877056127325312:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 211us (6354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.311021:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00010000:00010000:2.0:1790100453.312046:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312065:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312076:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312082:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312089:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312094:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100453.312099:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312105:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312116:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100453.312119:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100453.312123:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312128:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287884 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312138:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312143:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312155:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312159:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100453.312162:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312168:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312177:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926183194200) 00010000:00010000:2.0:1790100453.312179:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100453.312182:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.312188:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287876 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100453.312325:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+21:12363:x1877056127324928:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 37887us (38238us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1790100453.312334:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000020:00080000:2.0:1790100453.312356:0:12139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790100453.312435:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100453.312439:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100453.313593:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1790100453.313604:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100453.324915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100453.325858:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127325568 00000100:00100000:0.0:1790100453.325870:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127325568 00000100:00100000:0.0:1790100453.325941:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1790100453.325952:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+21:12363:x1877056127325568:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790100453.326202:0:6516:0:(mdd_object.c:4178:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790100453.326229:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1790100453.326256:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326271:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326282:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326290:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326297:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326303:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326329:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790100453.326420:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+23:12363:x1877056127325568:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 469us (1512us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1790100453.326428:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000020:00080000:0.0:1790100453.326433:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790100453.326474:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100453.326479:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326486:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46c00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100453.326490:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326498:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326509:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:0.0:1790100453.326512:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790100453.326516:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326522:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828788b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.326532:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100453.326533:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100453.326534:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100454.217003:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100454.749202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100454.749244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100454.749264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100454.749279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100454.749299:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100454.749320:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127325824 00000100:00100000:3.0:1790100454.749328:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127325824 00000100:00100000:3.0:1790100454.749383:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127325952 00000100:00100000:3.0:1790100454.749386:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127325952 00000100:00100000:3.0:1790100454.749403:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127326464 00000100:00100000:3.0:1790100454.749404:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127326464 00000100:00100000:3.0:1790100454.749716:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 255 00000100:00100000:3.0:1790100454.749726:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+23:2420:x1877056127325824:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100454.749791:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+23:2420:x1877056127325824:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.749799:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 255 00000100:00100000:3.0:1790100454.749814:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 256 00000100:00100000:3.0:1790100454.749831:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127325952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100454.749852:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127325952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.749858:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 256 00000100:00100000:3.0:1790100454.749867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 257 00000100:00100000:3.0:1790100454.749872:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127326464:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100454.749887:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127326464:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 15us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.749892:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 257 00000100:00100000:3.0:1790100454.749972:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127325696 00000100:00100000:3.0:1790100454.749984:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127325696 00000100:00100000:3.0:1790100454.750011:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 372 00000100:00100000:3.0:1790100454.750017:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2419:x1877056127325696:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100454.750045:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b5ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2419:x1877056127325696:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.750050:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 372 00000100:00100000:3.0:1790100454.752127:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100454.752207:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100454.752272:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127326208 00000100:00100000:3.0:1790100454.752278:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127326208 00000100:00100000:3.0:1790100454.752311:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127326080 00000100:00100000:3.0:1790100454.752314:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127326080 00000100:00100000:3.0:1790100454.752336:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:3.0:1790100454.752372:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127326208:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100454.752418:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127326208:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 48us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.752431:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:3.0:1790100454.752446:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1790100454.752452:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b8eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2420:x1877056127326080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100454.752478:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b8eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2420:x1877056127326080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.752484:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1790100454.752500:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127326336 00000100:00100000:3.0:1790100454.752504:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127326336 00000100:00100000:3.0:1790100454.753749:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 258 00000100:00100000:3.0:1790100454.753759:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127326336:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100454.753792:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127326336:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.753799:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 258 00000100:00080000:2.0:1790100454.767184:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100454.767200:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100454.767204:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1790100455.244051:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100455.363661:0:14742:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100455.363668:0:14742:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100455.363688:0:14742:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1790100455.363693:0:14742:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100455.560792:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100455.560843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127326720 00000100:00100000:0.0:1790100455.560856:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127326720 00000100:00100000:0.0:1790100455.560932:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:0.0:1790100455.560947:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+23:12381:x1877056127326720:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100455.560967:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100455.560999:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.561238:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287899 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.561253:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287899 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.561264:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287899 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100455.561274:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790100455.561389:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f2 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.561407:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287899 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f2 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.561416:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:0.0:1790100455.561420:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790100455.561540:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46c00, rc 0) 00000100:00100000:0.0:1790100455.561623:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12381:x1877056127326720:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 676us (839us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1790100455.561631:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00080000:2.0:1790100455.561704:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100455.563822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100455.566194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127326848 00000100:00100000:3.0:1790100455.566209:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127326848 00000100:00100000:3.0:1790100455.566319:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:3.0:1790100455.566330:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12381:x1877056127326848:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1790100455.566664:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.566682:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.566694:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.566722:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.566731:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.566738:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.566805:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.566814:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.566821:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100455.567027:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567054:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567060:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567079:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567086:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100455.567091:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567137:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567150:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:3.0:1790100455.567153:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100455.567166:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567174:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6600/0xc87a4f22982878a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567228:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567236:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567241:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567273:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100455.567276:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567282:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567288:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926190155000) 00010000:00010000:3.0:1790100455.567291:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100455.567294:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567310:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567325:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567331:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567362:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567368:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100455.567372:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567377:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567385:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff926190155d00) 00010000:00010000:3.0:1790100455.567387:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100455.567390:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.567396:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100455.568733:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12381:x1877056127326848:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 2399us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100455.568745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:1.0:1790100455.612472:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100455.614562:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127327104 00000100:00100000:1.0:1790100455.614574:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127327104 00000100:00100000:1.0:1790100455.614629:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:1.0:1790100455.614637:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12384:x1877056127327104:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100455.614655:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100455.614673:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982878bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e3f9 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.614735:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.614749:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.614758:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.614770:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.614777:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.614784:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.614872:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616570:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616594:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100455.616607:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790100455.616684:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616691:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616698:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616703:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100455.616707:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616714:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616725:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100455.616728:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100455.616732:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616738:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f22982878c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616748:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616753:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616763:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616768:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ea00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100455.616770:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616775:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616781:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1964600) 00010000:00010000:1.0:1790100455.616783:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100455.616785:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616790:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f22982878ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616828:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8fa00/0xc87a4f22982878bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 28 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616840:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 27 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.616847:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:1.0:1790100455.616849:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100455.616851:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f400, rc 0) 00000100:00100000:1.0:1790100455.617469:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12384:x1877056127327104:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2830us (5000us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1790100455.617486:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:3.0:1790100455.620425:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100455.620456:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127327232 00000100:00100000:3.0:1790100455.620465:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127327232 00000100:00100000:3.0:1790100455.620512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:3.0:1790100455.620522:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12384:x1877056127327232:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1790100455.620583:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620602:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620613:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620645:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620652:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620659:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620666:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100455.620670:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620678:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620688:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:3.0:1790100455.620692:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100455.620707:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.620714:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100455.620781:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12384:x1877056127327232:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 259us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100455.620788:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:3.0:1790100455.633805:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100455.633878:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127327488 00000100:00100000:2.0:1790100455.633889:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127327488 00000100:00100000:2.0:1790100455.633952:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1790100455.633962:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12384:x1877056127327488:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790100455.634180:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+28:12384:x1877056127327488:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 219us (383us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1790100455.634189:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1790100455.689444:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100455.689546:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127327744 00000100:00100000:3.0:1790100455.689556:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127327744 00000100:00100000:3.0:1790100455.689607:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:3.0:1790100455.689616:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+28:11908:x1877056127327744:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100455.689636:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100455.689653:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e400 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.689753:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.689766:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 29 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.689775:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.689801:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 29 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.689828:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 29 pid: 9338 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100455.689840:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140998144:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100455.689989:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261862f9600 going to sleep for 11 seconds 00000100:00100000:1.0:1790100455.698876:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100455.701547:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127327872 00000100:00100000:2.0:1790100455.701560:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127327872 00010000:00010000:2.0:1790100455.701606:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 30 pid: 9338 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100455.701663:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1790100455.701672:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+30:2422:x1877056127327872:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100455.701687:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100455.701693:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 30 pid: 9338 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.701706:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 30 pid: 9338 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.701727:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:2.0:1790100455.701745:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.701754:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.701761:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.701782:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100455.701847:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+30:2422:x1877056127327872:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 175us (2977us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100455.701855:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00010000:00010000:3.0:1790100455.703935:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f9 expref: 29 pid: 9338 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100455.703958:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140998144:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100455.703993:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.704004:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.704011:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100455.704031:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790100455.704179:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982878e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.704196:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.704204:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:3.0:1790100455.704218:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100455.704222:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6400, rc 0) 00000100:00100000:3.0:1790100455.704265:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+29:11908:x1877056127327744:12345-192.168.203.13@tcp:101:bash.0 Request processed in 14649us (14829us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1790100455.704273:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:2.0:1790100455.710293:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100455.710374:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127328000 00000100:00100000:1.0:1790100455.710384:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127328000 00000100:00100000:1.0:1790100455.710438:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:1.0:1790100455.710447:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+29:11908:x1877056127328000:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790100455.710471:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100455.710491:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e407 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.710536:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287902 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.710550:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.710561:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.710670:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982878fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e407 expref: 31 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.710686:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e407 expref: 30 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.710695:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:1.0:1790100455.710698:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100455.710701:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e200, rc 0) 00000100:00100000:1.0:1790100455.710764:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+30:11908:x1877056127328000:12345-192.168.203.13@tcp:101:bash.0 Request processed in 317us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100455.710770:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:1.0:1790100455.714191:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100455.714319:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127328256 00000100:00100000:3.0:1790100455.714371:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127328256 00000100:00100000:3.0:1790100455.714416:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:3.0:1790100455.714425:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+30:11908:x1877056127328256:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1790100455.714640:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.714658:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.714671:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100455.714709:0:6514:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1790100455.714731:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd5e21a9 reply state 000000008bf6e225 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.714743:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.714750:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:3.0:1790100455.714753:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790100455.714756:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790100455.714794:0:6514:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1790100455.714887:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+34:11908:x1877056127328256:12345-192.168.203.13@tcp:36:bash.0 Request processed in 462us (703us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1790100455.714902:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000020:00080000:3.0:1790100455.714912:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790100455.717846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100455.717941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127328384 00000100:00100000:0.0:1790100455.717960:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127328384 00000100:00100000:0.0:1790100455.718023:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:0.0:1790100455.718033:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+34:11908:x1877056127328384:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790100455.718062:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100455.718080:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287910 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e40e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.718249:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287910 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e40e expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.718262:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287910 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e40e expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.718280:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:0.0:1790100455.718283:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790100455.718286:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47e00, rc 0) 00000100:00100000:0.0:1790100455.718366:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+35:11908:x1877056127328384:12345-192.168.203.13@tcp:101:bash.0 Request processed in 307us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100455.718372:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:2.0:1790100455.721393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100455.721506:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127328512 00000100:00100000:3.0:1790100455.721515:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127328512 00000100:00100000:3.0:1790100455.721618:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1790100455.721629:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c197e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:11908:x1877056127328512:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100455.721645:0:10090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100455.721664:0:10090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e415 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100455.721687:0:10090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6ab2c3e3, atime: 0x6ab2c3e1, ctime: 0x6ab2c3e3, blocks: 0x8 00010000:00010000:3.0:1790100455.721707:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1790100455.721711:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100455.721720:0:10090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 8 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.721736:0:10090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 8 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.721748:0:10090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6600, rc 0) 00000100:00100000:3.0:1790100455.721803:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c197e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+8:11908:x1877056127328512:12345-192.168.203.13@tcp:101:bash.0 Request processed in 177us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100455.721809:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00080000:2.0:1790100455.722638:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100455.723942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100455.724073:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127328640 00000100:00100000:0.0:1790100455.724080:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127328640 00002000:00010000:0.0:1790100455.724126:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1790100455.724131:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926084973b80 with x1877056127328640 ext(0->18446744073709551615) 00002000:00010000:0.0:1790100455.724142:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926084973b80. 00000100:00100000:0.0:1790100455.724170:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1790100455.724179:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127328640:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:0.0:1790100455.724449:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790100455.724462:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790100451 -> 1790100455 00002000:00010000:0.0:1790100455.724464:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1790100449 -> 1790100449 00002000:00010000:0.0:1790100455.724466:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790100451 -> 1790100455 00002000:00010000:0.0:1790100455.724469:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1790100455.724510:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2421:x1877056127328640:12345-192.168.203.13@tcp:10:bash.0 Request processed in 332us (572us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1790100455.724527:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00002000:00010000:0.0:1790100455.724531:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1790100455.724534:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926084973b80 with x1877056127328640 ext(0->18446744073709551615) 00002000:00010000:0.0:1790100455.724539:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926084973b80. 00000100:00100000:0.0:1790100455.848386:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100455.849039:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127328768 00000100:00100000:2.0:1790100455.849050:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127328768 00000100:00100000:2.0:1790100455.849114:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:2.0:1790100455.849124:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12398:x1877056127328768:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1790100455.849200:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849218:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849229:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849244:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849270:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849277:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849380:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849390:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849397:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100455.849443:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849453:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849460:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849468:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849474:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100455.849479:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849486:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.849505:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100455.849508:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100455.850633:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850646:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828791e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850662:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850669:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850676:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850682:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100455.850685:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850692:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850701:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:2.0:1790100455.850704:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100455.850707:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850714:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287925 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850743:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850750:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850756:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850761:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100455.850763:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850769:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850776:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:2.0:1790100455.850779:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100455.850782:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.850787:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f229828792c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100455.850890:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12398:x1877056127328768:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1763us (2509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100455.850899:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:0.0:1790100455.880494:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100455.880519:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140998272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100455.880585:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100455.880656:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140998272 00000100:00100000:0.0:1790100455.880663:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140998272 00000100:00100000:0.0:1790100455.880718:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790100455.880727:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140998272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100455.880755:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790100455.880800:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056140998272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100455.880807:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1790100455.880828:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100455.880862:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056140998272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100455.880991:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140998400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100455.881043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100455.881878:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140998400 00000100:00100000:3.0:1790100455.881892:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140998400 00000100:00100000:3.0:1790100455.881933:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790100455.881953:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926082130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140998400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100455.881977:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790100455.882042:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926082130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056140998400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100455.882049:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1790100455.882065:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1790100455.886049:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1790100455.886065:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1790100455.891313:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056140998400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100455.963204:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100455.963294:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127329024 00000100:00100000:0.0:1790100455.963304:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127329024 00000100:00100000:0.0:1790100455.963406:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1790100455.963424:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+35:12401:x1877056127329024:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100455.963443:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100455.963462:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287933 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e41c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963532:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963547:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963558:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963572:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963578:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963583:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963686:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287948 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963696:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963704:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100455.963724:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790100455.963791:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963798:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963805:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963811:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100455.963815:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963823:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963840:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:0.0:1790100455.963843:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100455.963847:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963854:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828793a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963865:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963872:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963888:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963894:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100455.963897:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963903:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963912:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1af1f00) 00010000:00010000:0.0:1790100455.963915:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100455.963918:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963924:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287941 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963962:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287933 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e41c expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.963986:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e41c expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.964003:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:0.0:1790100455.964005:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790100455.964008:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:0.0:1790100455.965171:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+37:12401:x1877056127329024:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1744us (1971us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1790100455.965193:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:1.0:1790100455.983433:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100455.983603:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127329152 00000100:00100000:0.0:1790100455.983614:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127329152 00000100:00100000:0.0:1790100455.983672:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:0.0:1790100455.983682:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+37:12401:x1877056127329152:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1790100455.983743:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.983758:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.983767:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.983797:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.983810:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 37 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100455.983822:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140998528:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100455.983909:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100456.000936:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056140998528:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100456.000964:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100456.073427:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.073632:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127329408 00000100:00100000:2.0:1790100456.073643:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127329408 00000100:00100000:2.0:1790100456.073698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1790100456.073708:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+38:6181:x1877056127329408:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790100456.075259:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+39:6181:x1877056127329408:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 1545us (1834us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1790100456.075271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1790100456.079186:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100456.079450:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127329536 00000100:00100000:1.0:1790100456.079460:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127329536 00010000:00010000:1.0:1790100456.079497:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 39 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100456.079676:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:1.0:1790100456.079686:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+39:2422:x1877056127329536:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100456.079701:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100456.079707:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 39 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.079719:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 39 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.079739:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982878ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e400 expref: 39 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.079754:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:1.0:1790100456.079759:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.079780:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.079788:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.079818:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100456.079871:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+38:2422:x1877056127329536:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 187us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100456.079878:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00010000:00010000:2.0:1790100456.079946:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.079955:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.080007:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.080013:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.080020:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.080026:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.080030:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.080046:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.080066:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:2.0:1790100456.080069:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100456.080073:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.080079:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287956 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100456.080118:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+37:12401:x1877056127329152:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 96438us (96694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.080126:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:0.0:1790100456.083417:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100456.083579:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127329792 00000100:00100000:3.0:1790100456.083588:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127329792 00000100:00100000:3.0:1790100456.083642:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1790100456.083652:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+37:12401:x1877056127329792:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790100456.083856:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+38:12401:x1877056127329792:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 205us (447us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1790100456.083863:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1790100456.161755:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.161874:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127330048 00000100:00100000:2.0:1790100456.161883:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127330048 00000100:00100000:2.0:1790100456.162259:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:2.0:1790100456.162270:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+38:12412:x1877056127330048:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790100456.162295:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100456.162315:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828795d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e423 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162415:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162430:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162442:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162456:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162476:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162483:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162613:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287972 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162623:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162632:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100456.162642:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1790100456.162720:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162728:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162734:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162739:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.162744:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162751:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162773:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100456.162776:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100456.162782:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162788:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287964 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162801:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162807:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162813:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162818:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.162821:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162826:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162833:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:2.0:1790100456.162835:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100456.162837:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162843:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f229828796b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.162893:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828795d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e423 expref: 41 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.163132:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e423 expref: 40 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.163141:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:2.0:1790100456.163143:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100456.163146:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927200, rc 0) 00000100:00100000:2.0:1790100456.163329:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+40:12412:x1877056127330048:12345-192.168.203.13@tcp:101:cat.0 Request processed in 1060us (1582us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790100456.163378:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:0.0:1790100456.170119:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100456.170217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127330304 00000100:00100000:3.0:1790100456.170227:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127330304 00000100:00100000:3.0:1790100456.170321:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1790100456.170332:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+40:12412:x1877056127330304:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:3.0:1790100456.170729:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+41:12412:x1877056127330304:12345-192.168.203.13@tcp:35:cat.0 Request processed in 397us (618us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1790100456.170737:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1790100456.188584:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.188723:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127330560 00000100:00100000:2.0:1790100456.188734:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127330560 00000100:00100000:2.0:1790100456.188793:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:2.0:1790100456.188802:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+41:12413:x1877056127330560:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1790100456.188858:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1790100456.188885:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287910 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e40e expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.188925:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f2298287972 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e423 expref: 40 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.188949:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287948 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e41c expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287902 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e407 expref: 38 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189273:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:2.0:1790100456.189278:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100456.189301:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189314:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189324:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189427:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189436:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189443:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189526:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189536:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189543:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100456.189753:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1790100456.189763:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307477423455ns, next at 308477421107ns, rc = 0 00010000:00010000:2.0:1790100456.189803:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189812:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189819:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189827:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189833:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189840:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189862:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100456.189881:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189887:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189894:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.189899:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.190286:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190296:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190306:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:2.0:1790100456.190309:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790100456.190314:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190320:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f229828798e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190372:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190378:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190384:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190389:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.190392:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190398:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190405:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100456.190407:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100456.190417:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190423:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287980 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100456.190434:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084c68ce5 reply state 00000000303a613b transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190444:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.190451:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:2.0:1790100456.190453:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100456.190455:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100456.190736:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+39:12413:x1877056127330560:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1933us (2159us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790100456.190746:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00010000:00010000:0.0:1790100456.190813:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100456.190821:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.190827:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100456.190830:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.190836:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.190846:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:0.0:1790100456.190849:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790100456.190852:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.190857:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287995 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.190868:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100456.190870:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100456.190872:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100456.246785:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.246894:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127330816 00000100:00100000:2.0:1790100456.246920:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127330816 00000100:00100000:2.0:1790100456.247136:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:2.0:1790100456.247149:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+39:12419:x1877056127330816:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100456.247172:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100456.247195:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828799c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e42a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247293:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247309:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247375:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247389:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247397:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247405:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100456.247720:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1790100456.247849:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247859:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247867:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.247898:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248189:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248196:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248203:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.248214:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248222:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248236:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100456.248239:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100456.248243:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248250:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100456.248263:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ca95742 reply state 00000000ac22740e transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248273:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248280:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:2.0:1790100456.248283:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100456.248285:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790100456.248315:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f229828799c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248331:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.248411:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194e00) 00010000:00010000:2.0:1790100456.248415:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100456.248424:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927000, rc 0) 00000100:00100000:2.0:1790100456.248488:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+42:12419:x1877056127330816:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1343us (1712us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790100456.248496:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:2.0:1790100456.253752:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100456.253870:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127330944 00000100:00100000:3.0:1790100456.253880:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127330944 00000100:00100000:3.0:1790100456.253975:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1790100456.254010:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2421:x1877056127330944:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100456.254028:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100456.254046:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e431 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100456.254070:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790100456.254090:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1790100456.254094:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100456.254103:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.254122:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.254133:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:3.0:1790100456.254183:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2421:x1877056127330944:12345-192.168.203.13@tcp:101:bash.0 Request processed in 177us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.254190:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00080000:0.0:1790100456.254607:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790100456.316097:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100456.317322:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100456.319553:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127331072 00000100:00100000:3.0:1790100456.319565:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127331072 00000100:00100000:3.0:1790100456.319630:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1790100456.319639:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:12419:x1877056127331072:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100456.319656:0:10090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100456.319673:0:10090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e438 expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.319721:0:10090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.319739:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100456.319743:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100456.319748:0:10090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 7 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.319780:0:10090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.319792:0:10090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 7 pid: 8427 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.319805:0:10090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10090:1877056140998656:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100456.319896:0:10090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261862f9600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100456.325123:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.325263:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127331200 00000100:00100000:2.0:1790100456.325274:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127331200 00010000:00010000:2.0:1790100456.325315:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 8 pid: 8427 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100456.325397:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1790100456.325408:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127331200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100456.325422:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100456.325443:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 8 pid: 8427 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.325458:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 8 pid: 8427 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.325483:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100456.325487:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100456.325495:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 8 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.325505:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 8 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.325557:0:9513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 8 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100456.325572:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9513:1877056140998784:192.168.203.13@tcp:105: 00000100:00100000:2.0:1790100456.325636:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80900 going to sleep for 11 seconds 00010000:00010000:0.0:1790100456.325832:0:10090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f22982879bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e431 expref: 8 pid: 8427 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.325857:0:10090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10090:1877056140998656:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100456.325878:0:10090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 7 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.325889:0:10090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7200, rc 0) 00000100:00100000:0.0:1790100456.325929:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:12419:x1877056127331072:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6291us (8615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100456.325937:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1790100456.330753:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100456.330840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127331456 00000100:00100000:0.0:1790100456.330849:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127331456 00000100:00100000:0.0:1790100456.330899:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1790100456.330908:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+42:12419:x1877056127331456:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1790100456.331230:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+43:12419:x1877056127331456:12345-192.168.203.13@tcp:35:bash.0 Request processed in 321us (493us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1790100456.331238:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:2.0:1790100456.331748:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9513:1877056140998784:192.168.203.13@tcp:105: 00010000:00010000:2.0:1790100456.331769:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100456.331807:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127331200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 6401us (6703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.331817:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:3.0:1790100456.551438:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.551804:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127331584 00000100:00100000:2.0:1790100456.551816:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127331584 00000100:00100000:2.0:1790100456.551927:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:2.0:1790100456.551938:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+43:12435:x1877056127331584:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100456.551973:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100456.551994:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e43f expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.552059:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f22982879d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.552073:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f22982879d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.552086:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f22982879d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100456.552156:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790100456.552160:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100456.552180:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f22982879d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.552204:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e43f expref: 45 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.553541:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f22982879d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e43f expref: 44 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.553555:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100456.553558:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100456.553562:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926800, rc 0) 00000100:00100000:2.0:1790100456.553642:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+44:12435:x1877056127331584:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1706us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.553651:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:0.0:1790100456.562699:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100456.562787:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127331840 00000100:00100000:3.0:1790100456.562797:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127331840 00000100:00100000:3.0:1790100456.562857:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:3.0:1790100456.562867:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+44:12435:x1877056127331840:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100456.562886:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100456.562920:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f22982879db lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e446 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.563049:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982879e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.563064:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982879e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.563076:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982879e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100456.563087:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790100456.563196:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f22982879db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e446 expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.563215:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982879e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e446 expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.563223:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194e00) 00010000:00010000:3.0:1790100456.563226:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100456.563230:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:3.0:1790100456.563689:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+46:12435:x1877056127331840:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 821us (997us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1790100456.563697:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:0.0:1790100456.578454:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100456.578496:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.578618:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127332096 00000100:00100000:2.0:1790100456.578630:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127332096 00000100:00100000:2.0:1790100456.578700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:2.0:1790100456.578711:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+46:12435:x1877056127332096:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100456.578734:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100456.578753:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e44d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.578851:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982879f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.578882:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982879f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.578894:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982879f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100456.578907:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790100456.579015:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f22982879f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e44d expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.579032:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982879f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e44d expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.579039:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194e00) 00010000:00010000:2.0:1790100456.579042:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790100456.579045:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926a00, rc 0) 00000100:00100000:2.0:1790100456.579113:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+48:12435:x1877056127332096:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 404us (669us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1790100456.579121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:3.0:1790100456.579376:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127332224 00000100:00100000:3.0:1790100456.579382:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127332224 00000100:00100000:3.0:1790100456.579433:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1790100456.579441:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+48:2422:x1877056127332224:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100456.579461:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100456.579477:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f22982879e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e446 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.579488:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194e00) 00010000:00010000:3.0:1790100456.579491:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100456.579524:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+47:2422:x1877056127332224:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 84us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.579531:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790100456.593985:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100456.594068:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127332352 00000100:00100000:3.0:1790100456.594077:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127332352 00000100:00100000:3.0:1790100456.594133:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1790100456.594143:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+6:2422:x1877056127332352:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:3.0:1790100456.594189:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.594209:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 6 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.594217:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100456.594221:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100456.594225:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.594257:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 6 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.594289:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 6 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.594304:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1877056140998912:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100456.594764:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261862f9600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100456.604616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100456.604770:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127332480 00000100:00100000:1.0:1790100456.604779:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127332480 00002000:00100000:1.0:1790100456.604823:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9261a63fc700 x1877056127332480/t0(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:752/0 lens 504/0 e 0 to 0 dl 1790100467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100456.604834:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9261a63fc700 with x1877056127332480 ext(0->8) 00010000:00010000:1.0:1790100456.604844:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 7 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.604861:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 7 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100456.604869:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9261a63fc700 00000100:00100000:1.0:1790100456.604907:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1790100456.604916:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2421:x1877056127332480:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:1.0:1790100456.605832:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2421:x1877056127332480:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 913us (1219us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790100456.605852:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:1.0:1790100456.605861:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9261a63fc700 x1877056127332480/t4294967309(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:752/0 lens 504/448 e 0 to 0 dl 1790100467 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790100456.606126:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9261a63fc700 with x1877056127332480 ext(0->8) 00010000:00010000:1.0:1790100456.606137:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 9 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.606154:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 9 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100456.606162:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9261a63fc700 00000100:00100000:0.0:1790100456.607551:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1877056140998912:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100456.607578:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100456.623236:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100456.623318:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127332608 00000100:00100000:3.0:1790100456.623329:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127332608 00010000:00010000:2.0:1790100456.623678:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 9 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100456.623722:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:2.0:1790100456.623733:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2421:x1877056127332608:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100456.623747:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790100456.623775:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790100456.623778:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790100455 00002000:00010000:2.0:1790100456.623780:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790100455 00002000:00010000:2.0:1790100456.623783:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1790100455 00002000:00010000:2.0:1790100456.623785:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1790100456.623791:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 9 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.623806:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 9 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.624377:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064aef45f/0xc87a4f22982879c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e438 expref: 9 pid: 10090 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.624503:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100456.624508:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100456.624515:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.624525:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.624562:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100456.624625:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2421:x1877056127332608:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 893us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.624633:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00010000:00010000:0.0:1790100456.624707:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.624716:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.624738:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.624744:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.624751:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.624757:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100456.624761:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.624769:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.624782:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.624804:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff7f825c/0xc87a4f2298287a05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.624851:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127332352:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 30710us (30885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100456.624859:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1790100456.633288:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.633400:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127332864 00000100:00100000:2.0:1790100456.633420:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127332864 00000100:00100000:2.0:1790100456.633477:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1790100456.633487:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+47:12435:x1877056127332864:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:2.0:1790100456.633545:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982879f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e44d expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100456.633719:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1790100456.633754:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1790100456.634039:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1790100456.634073:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.634088:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.634097:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.634132:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.634146:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 51 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100456.634158:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877056140999040:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100456.634250:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100456.637262:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877056140999040:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100456.637291:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.644502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100456.644586:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127332992 00000100:00100000:3.0:1790100456.644595:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127332992 00010000:00010000:3.0:1790100456.644633:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 52 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.644681:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:3.0:1790100456.644691:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+52:2422:x1877056127332992:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100456.644705:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100456.644711:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 52 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.644724:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 52 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.644744:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f22982879b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e42a expref: 52 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.644760:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194e00) 00010000:00010000:3.0:1790100456.644765:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.644781:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.644788:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.644821:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100456.644876:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+51:2422:x1877056127332992:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 186us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.644884:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00010000:00010000:2.0:1790100456.646896:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.646911:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100456.647030:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1790100456.647140:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1790100456.647219:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140999168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790100456.647274:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100456.647316:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083b800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100456.647539:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140999168 00000100:00100000:0.0:1790100456.647547:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140999168 00000100:00100000:0.0:1790100456.647605:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790100456.647614:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140999168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790100456.647703:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140999168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100456.647709:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790100456.647791:0:6516:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1790100456.647797:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1790100456.647814:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9260848c0a80, transno 4294967308 00000100:00100000:1.0:1790100456.647835:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140999168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790100456.647938:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1790100456.648003:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084972d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140999296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790100456.648032:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100456.648061:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6141540 going to sleep for 11 seconds 00000100:00100000:1.0:1790100456.648075:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140999296 00000100:00100000:1.0:1790100456.648078:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140999296 00000100:00100000:1.0:1790100456.648112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790100456.648119:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1877056140999296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790100456.648209:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1877056140999296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (175us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790100456.648230:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790100456.648261:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084972d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877056140999296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790100456.648290:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1790100456.648316:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.648324:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.648331:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.648363:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100456.648368:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.648377:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.648391:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194e00) 00010000:00010000:1.0:1790100456.648395:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790100456.648400:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.648407:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287a0c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790100456.648487:0:6516:0:(mdd_object.c:4178:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790100456.648540:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1790100456.648552:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307936212020ns, next at 308936209437ns, rc = 0 00000001:00080000:1.0:1790100456.648564:0:6516:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1790100456.648585:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194e00) 00010000:00010000:1.0:1790100456.648588:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790100456.648594:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f22982879f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e44d expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100456.648673:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+54:12435:x1877056127332864:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 15187us (15394us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1790100456.648681:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000020:00080000:1.0:1790100456.648685:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1790100456.651785:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100456.653423:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.653787:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127333120 00000100:00100000:2.0:1790100456.653796:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127333120 00000100:00100000:2.0:1790100456.653848:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:2.0:1790100456.653859:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608491b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+54:12435:x1877056127333120:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100456.653882:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100456.653904:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287a13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e454 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.653970:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287a13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e454 expref: 55 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.653986:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287a13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e454 expref: 55 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.654093:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100456.654158:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100456.654174:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927600, rc 0) 00000100:00100000:2.0:1790100456.655116:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608491b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+55:12435:x1877056127333120:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1254us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.655126:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:3.0:1790100456.665569:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100456.665665:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127333376 00000100:00100000:0.0:1790100456.665674:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127333376 00000100:00100000:0.0:1790100456.665728:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1790100456.665738:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+55:12435:x1877056127333376:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1790100456.665971:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+56:12435:x1877056127333376:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 226us (402us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1790100456.665980:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1790100456.789843:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.790026:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127333504 00000100:00100000:2.0:1790100456.790036:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127333504 00000100:00100000:2.0:1790100456.790103:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:2.0:1790100456.790113:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+56:12445:x1877056127333504:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1790100456.790191:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790209:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790224:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790236:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790244:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790251:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790326:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790335:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790406:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100456.790467:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790481:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790487:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790495:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790500:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.790505:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790518:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790530:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100456.790533:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100456.790538:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790544:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790556:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790568:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790573:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790578:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.790580:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790587:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.790594:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:2.0:1790100456.790596:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100456.790598:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.791061:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.791075:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.791081:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.791087:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.791092:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.791100:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.791106:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.791114:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100456.791116:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100456.791120:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.791126:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100456.791213:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+56:12445:x1877056127333504:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1099us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.791221:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:3.0:1790100456.835593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100456.836619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127333760 00000100:00100000:0.0:1790100456.836644:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127333760 00000100:00100000:0.0:1790100456.836711:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:0.0:1790100456.836721:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+56:12448:x1877056127333760:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100456.836741:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100456.836761:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e45b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.836841:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.836856:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.836868:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.836879:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.836887:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.836893:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837003:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287a44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837012:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837019:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100456.837036:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790100456.837109:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837117:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837124:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837129:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100456.837133:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837141:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837152:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:0.0:1790100456.837155:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100456.837160:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837166:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287a36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837179:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837185:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837201:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837206:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100456.837209:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837216:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837225:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:0.0:1790100456.837228:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100456.837231:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837237:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837273:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e45b expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837286:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287a44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e45b expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.837294:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100456.837296:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100456.837298:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46800, rc 0) 00000100:00100000:0.0:1790100456.837953:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+58:12448:x1877056127333760:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1231us (2368us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1790100456.837979:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:0.0:1790100456.845149:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100456.845378:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127333888 00000100:00100000:2.0:1790100456.845396:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127333888 00000100:00100000:2.0:1790100456.845610:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:2.0:1790100456.845622:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608491b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+58:12448:x1877056127333888:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790100456.845684:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845700:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845711:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845744:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845764:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845783:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845788:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100456.845793:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845801:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845813:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100456.845816:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100456.845821:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.845827:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100456.845896:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608491b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+58:12448:x1877056127333888:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 276us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.845910:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:1.0:1790100456.854317:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100456.855388:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127334144 00000100:00100000:0.0:1790100456.855403:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127334144 00000100:00100000:0.0:1790100456.855479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1790100456.855490:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+58:12448:x1877056127334144:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1790100456.855891:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+59:12448:x1877056127334144:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 402us (1582us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1790100456.856862:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:2.0:1790100456.912882:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140999424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100456.912959:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100456.913139:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140999424 00000100:00100000:3.0:1790100456.913148:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140999424 00000100:00100000:3.0:1790100456.913202:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790100456.913213:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140999424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100456.913248:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790100456.913299:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056140999424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.913305:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790100456.913373:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056140999424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100456.993908:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100456.994760:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127334400 00000100:00100000:0.0:1790100456.994786:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127334400 00000100:00100000:0.0:1790100456.994854:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:0.0:1790100456.994864:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+59:12458:x1877056127334400:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790100456.994887:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100456.994890:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790100456.994927:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f22982879d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e43f expref: 59 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.994949:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:0.0:1790100456.994955:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100456.994978:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a59 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e462 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.995085:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.995114:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.995124:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100456.995135:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790100456.995238:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e462 expref: 61 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.995252:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e462 expref: 60 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.995259:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100456.995261:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100456.995264:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:0.0:1790100456.995328:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+60:12458:x1877056127334400:12345-192.168.203.13@tcp:101:bash.0 Request processed in 466us (1440us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1790100456.995335:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:0.0:1790100457.003079:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.003594:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127334528 00000100:00100000:3.0:1790100457.003604:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127334528 00000100:00100000:3.0:1790100457.003680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:3.0:1790100457.003690:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608491bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+60:12458:x1877056127334528:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100457.003727:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100457.003748:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298287a6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e469 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.003782:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.003796:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.003806:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.003924:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298287a6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.003940:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.003948:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:3.0:1790100457.003951:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790100457.003954:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6400, rc 0) 00000100:00100000:3.0:1790100457.004019:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608491bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+61:12458:x1877056127334528:12345-192.168.203.13@tcp:101:bash.0 Request processed in 330us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.004025:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:3.0:1790100457.004114:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.004140:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127334656 00000100:00100000:3.0:1790100457.004144:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127334656 00000100:00100000:3.0:1790100457.004173:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1790100457.004186:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+61:2421:x1877056127334656:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100457.004196:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100457.004211:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287a60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e462 expref: 61 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.004222:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:3.0:1790100457.004225:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100457.004296:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+60:2421:x1877056127334656:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 110us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.004304:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00080000:1.0:1790100457.004558:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100457.010149:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.010284:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127334912 00000100:00100000:0.0:1790100457.010297:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127334912 00000100:00100000:0.0:1790100457.010404:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:0.0:1790100457.010414:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+60:12458:x1877056127334912:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:0.0:1790100457.010471:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100457.010498:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287a44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e45b expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.010535:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100457.010540:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100457.010691:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.010704:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.010714:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100457.010749:0:6512:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1790100457.010770:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006db0c0a reply state 00000000736d35cb transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.010781:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.010787:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100457.010789:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790100457.010791:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100457.010877:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+62:12458:x1877056127334912:12345-192.168.203.13@tcp:36:bash.0 Request processed in 464us (738us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1790100457.010884:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 223 00000020:00080000:0.0:1790100457.010889:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790100457.017929:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.018013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127335040 00000100:00100000:3.0:1790100457.018025:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127335040 00000100:00100000:3.0:1790100457.018085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:3.0:1790100457.018095:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608491a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+62:12458:x1877056127335040:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790100457.018126:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100457.018146:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287a83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e470 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.018235:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.018248:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.018259:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100457.018309:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790100457.018313:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100457.018332:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.018395:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287a83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.018411:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.018419:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:3.0:1790100457.018422:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100457.018426:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:3.0:1790100457.018477:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608491a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+63:12458:x1877056127335040:12345-192.168.203.13@tcp:101:bash.0 Request processed in 383us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.018484:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:3.0:1790100457.039236:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.039581:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127335296 00000100:00100000:0.0:1790100457.039591:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127335296 00000100:00100000:0.0:1790100457.039644:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1790100457.039654:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+63:12458:x1877056127335296:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1790100457.039898:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+64:12458:x1877056127335296:12345-192.168.203.13@tcp:35:bash.0 Request processed in 240us (665us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1790100457.039906:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1790100457.152675:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.152781:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127335424 00000100:00100000:2.0:1790100457.152791:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127335424 00000100:00100000:2.0:1790100457.152850:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:2.0:1790100457.152861:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+64:12464:x1877056127335424:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100457.152907:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100457.152927:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e477 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.153006:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.153020:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.153032:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100457.153072:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790100457.153076:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100457.153094:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.153131:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926a00/0xc87a4f2298287a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e477 expref: 66 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.153150:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e477 expref: 65 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.153158:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100457.153161:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100457.153164:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927000, rc 0) 00000100:00100000:2.0:1790100457.153227:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+65:12464:x1877056127335424:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 368us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.153234:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:3.0:1790100457.157090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.157224:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127335552 00000100:00100000:2.0:1790100457.157234:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127335552 00000100:00100000:2.0:1790100457.157287:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:2.0:1790100457.157297:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+65:12464:x1877056127335552:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100457.157315:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100457.157376:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e47e expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157453:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157469:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157480:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157491:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157498:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157515:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157581:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287ab4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157590:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157614:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100457.157653:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790100457.157657:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100457.157675:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157687:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157695:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157702:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157710:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157716:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100457.157720:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157728:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157739:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100457.157742:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100457.157747:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157763:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287aa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157776:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157783:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157789:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157795:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100457.157798:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157805:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157812:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:2.0:1790100457.157815:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100457.157818:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157824:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287aad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157850:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287a9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e47e expref: 67 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157875:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e47e expref: 66 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.157883:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100457.157885:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100457.157887:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926800, rc 0) 00000100:00100000:2.0:1790100457.157957:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12464:x1877056127335552:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 661us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.157974:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:3.0:1790100457.160910:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.161008:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.161329:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127335936 00000100:00100000:1.0:1790100457.161384:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127335936 00000100:00100000:1.0:1790100457.161448:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1790100457.161459:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+66:2421:x1877056127335936:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100457.161485:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100457.161508:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287ab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e47e expref: 66 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.161527:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100457.161532:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100457.161576:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+65:2421:x1877056127335936:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 119us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.161584:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1790100457.173097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127335808 00000100:00100000:0.0:1790100457.173112:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127335808 00000100:00100000:0.0:1790100457.173327:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:0.0:1790100457.173351:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+65:12464:x1877056127335808:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100457.173371:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100457.173392:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287abb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e485 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.173491:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.173515:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.173524:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.173558:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.173571:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 66 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.173584:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084918380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877056140999552:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100457.173699:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260839e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100457.176427:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084918380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877056140999552:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100457.176455:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.176772:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.176839:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127336064 00000100:00100000:1.0:1790100457.176846:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127336064 00010000:00010000:1.0:1790100457.176891:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 67 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.176930:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:1.0:1790100457.176940:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+67:2421:x1877056127336064:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100457.176954:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100457.176969:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 67 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.176982:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 67 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.177005:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298287a8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e470 expref: 67 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.177022:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100457.177027:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.177036:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.177045:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.177074:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100457.177138:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+66:2421:x1877056127336064:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 200us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.177158:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00010000:00010000:0.0:1790100457.177540:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.177549:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100457.177568:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790100457.177686:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287abb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.177700:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.177707:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100457.177710:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790100457.177712:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47e00, rc 0) 00000100:00100000:0.0:1790100457.177747:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12464:x1877056127335808:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 4411us (16857us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1790100457.177755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:3.0:1790100457.180903:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.180984:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127336320 00000100:00100000:1.0:1790100457.180993:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127336320 00000100:00100000:1.0:1790100457.181055:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790100457.181066:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184256850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12464:x1877056127336320:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:1.0:1790100457.181079:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100457.181102:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287a13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e454 expref: 66 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.181128:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100457.181133:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100457.181183:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184256850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+65:12464:x1877056127336320:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 118us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.181190:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790100457.186046:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.186131:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127336448 00000100:00100000:0.0:1790100457.186140:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127336448 00000100:00100000:0.0:1790100457.186196:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:0.0:1790100457.186205:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+65:12464:x1877056127336448:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1790100457.186316:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.186332:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.186376:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100457.186473:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1790100457.186541:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+65:12464:x1877056127336448:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 336us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.186549:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:3.0:1790100457.188996:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.189123:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127336576 00000100:00100000:2.0:1790100457.189131:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127336576 00000100:00100000:2.0:1790100457.189181:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:2.0:1790100457.189190:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+65:12464:x1877056127336576:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100457.189206:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100457.189224:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e48c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.189270:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.189281:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.189297:0:6513:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.189310:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.189370:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100457.189373:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100457.189377:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.189393:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927800, rc 0) 00000100:00100000:2.0:1790100457.189437:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12464:x1877056127336576:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 248us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.189443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 229 00010000:00010000:2.0:1790100457.288990:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100457.420367:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100457.422107:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140999680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100457.422180:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100457.422256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056140999680 00000100:00100000:2.0:1790100457.422265:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056140999680 00000100:00100000:2.0:1790100457.422314:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790100457.422324:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140999680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100457.422372:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100457.422423:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056140999680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.422431:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790100457.422472:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056140999680:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1790100457.608689:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100457.608698:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100457.608732:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1790100457.608740:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100457.608909:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084918380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140999808:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790100457.609634:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790100457.627481:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.630536:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084918380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056140999808:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790100457.631946:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127336704 00000100:00100000:1.0:1790100457.631966:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127336704 00000100:00100000:1.0:1790100457.632028:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:1.0:1790100457.632038:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12466:x1877056127336704:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790100457.632066:0:6514:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790100457.632185:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12466:x1877056127336704:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 148us (4721us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.632206:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:3.0:1790100457.639038:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.639353:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127336832 00000100:00100000:2.0:1790100457.639364:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127336832 00000100:00100000:2.0:1790100457.639425:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:2.0:1790100457.639436:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12466:x1877056127336832:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790100457.639514:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639531:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639558:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639574:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639582:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639589:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639618:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639628:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639634:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100457.639679:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790100457.639684:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100457.639695:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639705:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639711:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639728:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639734:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100457.639738:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639745:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639757:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:2.0:1790100457.639760:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100457.639764:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639770:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926200/0xc87a4f2298287ade lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639783:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639788:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639795:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.639801:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100457.639817:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640568:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640578:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff926183194800) 00010000:00010000:2.0:1790100457.640581:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100457.640584:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640591:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287ae5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640609:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640615:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640620:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640626:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100457.640629:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640634:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640641:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100457.640643:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100457.640646:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.640662:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287aec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.641665:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12466:x1877056127336832:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 2225us (2630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.641677:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:3.0:1790100457.644292:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.644571:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127337088 00000100:00100000:1.0:1790100457.644581:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127337088 00000100:00100000:1.0:1790100457.644640:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:1.0:1790100457.644650:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+66:12466:x1877056127337088:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100457.644669:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100457.644688:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287af3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e493 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644794:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644811:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644822:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100457.644832:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790100457.644919:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644927:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644935:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644941:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100457.644946:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644970:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644983:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100457.644986:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100457.644991:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.644998:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f200/0xc87a4f2298287afa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.645038:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287af3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e493 expref: 68 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.645049:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:1.0:1790100457.645051:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100457.645055:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287af3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e493 expref: 68 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.645066:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e800, rc 0) 00000100:00100000:1.0:1790100457.645125:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+67:12466:x1877056127337088:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 476us (841us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1790100457.645132:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:3.0:1790100457.649285:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.649374:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127337216 00000100:00100000:0.0:1790100457.649394:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127337216 00000100:00100000:0.0:1790100457.649451:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:0.0:1790100457.649462:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+67:12466:x1877056127337216:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790100457.649495:0:6512:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790100457.649612:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+67:12466:x1877056127337216:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 151us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.649633:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:3.0:1790100457.652779:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.653331:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127337472 00000100:00100000:2.0:1790100457.653375:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127337472 00000100:00100000:2.0:1790100457.653446:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:2.0:1790100457.653457:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+67:12466:x1877056127337472:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100457.653478:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100457.653481:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790100457.653524:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287a98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e477 expref: 67 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.653542:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:2.0:1790100457.653547:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100457.653559:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b08 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e49a expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100457.653890:0:12139:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1790100457.654872:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287b0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.654887:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.654897:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.655042:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e49a expref: 69 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.655058:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287b0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e49a expref: 68 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.655067:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926183194800) 00010000:00010000:2.0:1790100457.655070:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100457.655073:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927e00, rc 0) 00000100:00100000:2.0:1790100457.655191:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+68:12466:x1877056127337472:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1736us (2422us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790100457.655200:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:1.0:1790100457.661178:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.661266:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127337728 00000100:00100000:0.0:1790100457.661277:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127337728 00000100:00100000:0.0:1790100457.661363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:0.0:1790100457.661375:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+68:12466:x1877056127337728:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100457.661444:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100457.661469:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287b0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e49a expref: 68 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661489:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926183194800) 00010000:00010000:0.0:1790100457.661510:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100457.661531:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661545:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661554:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661611:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661618:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661626:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661687:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661695:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661701:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661718:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.661723:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661730:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661739:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:0.0:1790100457.661742:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.661746:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661753:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287b1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661762:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661769:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661774:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661786:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.661789:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661794:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661802:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x45e08c18 (ffff9261c1af1f00) 00010000:00010000:0.0:1790100457.661804:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.661807:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.661812:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287b24 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x45e08c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.663668:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+67:12466:x1877056127337728:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 520us (724us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100457.663683:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:2.0:1790100457.666675:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.666797:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127337856 00000100:00100000:3.0:1790100457.666807:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127337856 00000100:00100000:3.0:1790100457.666864:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:3.0:1790100457.666875:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+67:12466:x1877056127337856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100457.666903:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100457.666927:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298287b2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.666972:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.666985:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.666996:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.667105:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7800/0xc87a4f2298287b2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.667122:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.667130:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:3.0:1790100457.667133:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790100457.667137:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7200, rc 0) 00000100:00100000:3.0:1790100457.667194:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+68:12466:x1877056127337856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 322us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.667210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:3.0:1790100457.679068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.680202:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127338112 00000100:00100000:2.0:1790100457.680214:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127338112 00000100:00100000:2.0:1790100457.680279:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:2.0:1790100457.680289:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+68:12466:x1877056127338112:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100457.680444:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.680461:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.680473:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100457.680625:0:12139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1790100457.680641:0:12139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308968301544ns, next at 309968299711ns, rc = 0 00000004:00010000:2.0:1790100457.680684:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044696b4f reply state 000000005ad06798 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.680697:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.680705:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:2.0:1790100457.680708:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790100457.680712:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100457.680810:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+70:12466:x1877056127338112:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 521us (1750us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790100457.680818:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:0.0:1790100457.688427:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.688609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127338240 00000100:00100000:1.0:1790100457.688619:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127338240 00000100:00100000:1.0:1790100457.688677:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:1.0:1790100457.688688:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+70:12466:x1877056127338240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100457.688731:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100457.688752:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.688808:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 71 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.688823:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 71 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.688843:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:1.0:1790100457.688846:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100457.688849:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e800, rc 0) 00000100:00100000:1.0:1790100457.689090:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+71:12466:x1877056127338240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 403us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.689098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:3.0:1790100457.691015:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.691186:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127338368 00000100:00100000:2.0:1790100457.691194:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127338368 00000100:00100000:2.0:1790100457.691250:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1790100457.691259:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2419:x1877056127338368:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790100457.691773:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2419:x1877056127338368:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 513us (763us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1790100457.691781:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00080000:1.0:1790100457.692482:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100457.696436:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.696602:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127338624 00000100:00100000:0.0:1790100457.696612:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127338624 00000100:00100000:0.0:1790100457.696670:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1790100457.696680:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+71:12466:x1877056127338624:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790100457.696885:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+72:12466:x1877056127338624:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 206us (458us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1790100457.696965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1790100457.698844:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.704789:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127338880 00000100:00100000:1.0:1790100457.704803:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127338880 00000100:00100000:1.0:1790100457.704881:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:1.0:1790100457.704906:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+72:12466:x1877056127338880:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790100457.705041:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+72:12466:x1877056127338880:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 150us (6203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.705049:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:0.0:1790100457.709100:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.709375:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127339008 00000100:00100000:2.0:1790100457.709394:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127339008 00000100:00100000:2.0:1790100457.709448:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:2.0:1790100457.709457:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+72:12466:x1877056127339008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100457.709475:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100457.709495:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287b47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4af expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.709581:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287b4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.709597:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.709609:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100457.709653:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100457.709671:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.709704:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287b47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4af expref: 74 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.709722:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287b4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4af expref: 73 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.709730:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:2.0:1790100457.709733:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790100457.709736:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926800, rc 0) 00000100:00100000:2.0:1790100457.710098:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+73:12466:x1877056127339008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 640us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.710105:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:0.0:1790100457.721232:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.721307:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127339136 00000100:00100000:2.0:1790100457.721318:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127339136 00000100:00100000:2.0:1790100457.721396:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:2.0:1790100457.721420:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608491ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+10:2421:x1877056127339136:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100457.721438:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100457.721456:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4b6 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100457.721477:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c3e9, blocks: 0x0 00010000:00010000:2.0:1790100457.721494:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1790100457.721499:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100457.721517:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.721534:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.721546:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927000, rc 0) 00000100:00100000:2.0:1790100457.721597:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608491ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2421:x1877056127339136:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 180us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.721604:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:0.0:1790100457.733529:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.733617:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127339392 00000100:00100000:1.0:1790100457.733627:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127339392 00000100:00100000:1.0:1790100457.733687:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:1.0:1790100457.733713:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+73:12466:x1877056127339392:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790100457.733826:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+73:12466:x1877056127339392:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 116us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.733833:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:1.0:1790100457.736171:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.736256:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127339520 00000100:00100000:0.0:1790100457.736264:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127339520 00000100:00100000:0.0:1790100457.736319:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1790100457.736330:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+11:12466:x1877056127339520:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100457.737188:0:10090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100457.737211:0:10090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4bd expref: -99 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.737245:0:10090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 12 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.737254:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100457.737258:0:10090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100457.737264:0:10090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 12 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.737302:0:10090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 12 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.737318:0:10090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 12 pid: 8426 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.737332:0:10090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608491aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10090:1877056140999936:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100457.740819:0:10090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260849923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100457.745255:0:10090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608491aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10090:1877056140999936:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100457.745290:0:10090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 12 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.745311:0:10090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:3.0:1790100457.745406:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+12:12466:x1877056127339520:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 9078us (9242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.745414:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:3.0:1790100457.747900:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.748187:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127339648 00000100:00100000:1.0:1790100457.748196:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127339648 00010000:00010000:1.0:1790100457.748237:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 12 pid: 8426 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.748276:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1790100457.748285:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+12:2421:x1877056127339648:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100457.748299:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100457.748318:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 12 pid: 8426 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.748333:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 12 pid: 8426 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.748379:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d431a37/0xc87a4f2298287b55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4b6 expref: 12 pid: 8426 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.748396:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100457.748401:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100457.748408:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 11 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.748432:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 11 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.748468:0:9513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 11 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.748494:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084971880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9513:1877056141000064:192.168.203.13@tcp:105: 00000100:00100000:1.0:1790100457.748579:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6141780 going to sleep for 11 seconds 00000100:00100000:3.0:1790100457.753052:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084971880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9513:1877056141000064:192.168.203.13@tcp:105: 00010000:00010000:3.0:1790100457.753076:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100457.753142:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2421:x1877056127339648:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4856us (5258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.753152:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1790100457.755982:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.756073:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127339776 00000100:00100000:2.0:1790100457.756083:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127339776 00002000:00100000:2.0:1790100457.756130:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff926084970000 x1877056127339776/t0(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:753/0 lens 504/0 e 0 to 0 dl 1790100468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100457.756141:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926084970000 with x1877056127339776 ext(0->12) 00002000:00010000:2.0:1790100457.756147:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926084970000 00000100:00100000:2.0:1790100457.756178:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1790100457.756189:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+11:2421:x1877056127339776:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790100457.759663:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+13:2421:x1877056127339776:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 3464us (3678us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1790100457.759677:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00002000:00100000:2.0:1790100457.759689:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff926084970000 x1877056127339776/t4294967321(0) o4->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:753/0 lens 504/448 e 0 to 0 dl 1790100468 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100457.759700:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926084970000 with x1877056127339776 ext(0->12) 00002000:00010000:2.0:1790100457.759706:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926084970000 00000100:00100000:1.0:1790100457.775536:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.775649:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127339904 00000100:00100000:0.0:1790100457.775660:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127339904 00000100:00100000:0.0:1790100457.775727:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:0.0:1790100457.775739:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+73:12466:x1877056127339904:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790100457.779055:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1790100457.779071:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1790100457.779103:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1790100457.779124:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9261a61410c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1790100457.779129:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083b92300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9261a6141600 00000020:00080000:1.0:1790100457.779133:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083b92d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff926082111200 00000004:00080000:1.0:1790100457.779157:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1790100457.779189:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9261b8cc6000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1790100457.779193:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083b92000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92618629b6c0 00000020:00080000:1.0:1790100457.779196:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083b92c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff926183eb5000 00000100:00100000:2.0:1790100457.779234:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141000192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790100457.779293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100457.779474:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141000192 00000100:00100000:1.0:1790100457.779481:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141000192 00000020:00080000:3.0:1790100457.779493:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1790100457.779522:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100457.779531:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1877056141000192:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1790100457.779563:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00002000:00080000:1.0:1790100457.779567:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00000100:00100000:3.0:1790100457.779578:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141000448:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790100457.779594:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6ab2c3e7, atime: 0x6ab2c3e7, ctime: 0x6ab2c3e7, blocks: 0x8 00010000:00010000:1.0:1790100457.779603:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.779619:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=309s v=(0 0) 00000100:00100000:3.0:1790100457.779625:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790100457.779626:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100457.779635:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.779651:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.779654:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100457.779665:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141000320:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790100457.779666:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.779674:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.779693:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790100457.779706:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100457.779732:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141000448 00000100:00100000:3.0:1790100457.779737:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141000448 00000100:00100000:3.0:1790100457.779774:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141000320 00000100:00100000:3.0:1790100457.779778:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141000320 00000100:00100000:1.0:1790100457.779801:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1877056141000192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 270us (507us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790100457.779809:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790100457.780006:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790100457.780021:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1877056141000448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790100457.780100:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790100457.780104:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1790100457 00002000:00010000:3.0:1790100457.780106:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790100457.780108:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790100457 -> 1790100457 00002000:00010000:3.0:1790100457.780109:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1790100457.780151:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1877056141000448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (528us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1790100457.780158:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790100457.780171:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790100457.780178:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1877056141000320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790100457.780190:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1790100457.780202:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.780217:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 12 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.780225:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1790100457.780229:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100457.780233:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.780266:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 12 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.780281:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 12 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.780293:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084b40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056141000576:192.168.203.13@tcp:104: 00000004:00080000:2.0:1790100457.780332:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9261a63ff100/2, rc 0, transno 4294967311 00000100:00100000:2.0:1790100457.780357:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141000192:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790100457.780366:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780374:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780381:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780387:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.780391:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780399:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780414:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff926183194a00) 00010000:00010000:0.0:1790100457.780418:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.780423:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780428:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6e00/0xc87a4f2298287861 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780452:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780459:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780473:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780478:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.780481:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780487:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780495:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9261c1964c00) 00010000:00010000:0.0:1790100457.780498:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.780501:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780507:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298287909 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780522:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780529:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780534:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780540:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.780542:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780559:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780568:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:0.0:1790100457.780570:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.780573:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780579:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926600/0xc87a4f2298287987 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780591:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780597:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780602:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780608:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.780612:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780618:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780627:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff926183194200) 00010000:00010000:0.0:1790100457.780630:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.780633:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780646:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927200/0xc87a4f22982879aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780662:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780668:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780674:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780679:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.780682:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780687:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780695:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100457.780697:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.780699:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780704:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287a7c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780713:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780719:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780731:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780736:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.780738:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780743:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780751:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:0.0:1790100457.780754:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790100457.780756:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780761:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287b39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780785:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100457.780790:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780798:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100457.780802:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780809:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780832:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780852:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091cc6899/0xc87a4f2298287b63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.780871:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100457.780873:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100457.780874:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100457.781580:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261862f9480 going to sleep for 11 seconds 00000004:00080000:3.0:1790100457.781617:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff926084b40700/2, rc 0, transno 4294967322 00000100:00100000:3.0:1790100457.781625:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141000448:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1790100457.781646:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100457.781782:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+21:12466:x1877056127339904:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 6043us (6255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.781792:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:1.0:1790100457.784686:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.784744:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.784828:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127340032 00000100:00100000:2.0:1790100457.784837:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127340032 00010000:00010000:2.0:1790100457.784887:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 13 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.784940:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:2.0:1790100457.784950:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084972680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+13:2421:x1877056127340032:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100457.784973:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100457.784979:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 13 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.784995:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 13 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.785044:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100457.785049:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100457.785055:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.785066:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.785088:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100457.785145:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084972680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+13:2421:x1877056127340032:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 196us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.785153:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1790100457.785368:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127340160 00000100:00100000:0.0:1790100457.785372:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127340160 00000100:00100000:0.0:1790100457.785400:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1790100457.785408:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+13:2422:x1877056127340160:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1790100457.785553:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a616fa0/0xc87a4f2298287917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e415 expref: 13 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.785571:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084b40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1877056141000576:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100457.785664:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.785676:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.785684:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.785706:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.785714:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.785729:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790100457.786007:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1877056141000320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5829us (6300us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790100457.786015:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1790100457.786456:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100457.786464:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.786474:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100457.786477:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.786487:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.786514:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.786534:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063158d75/0xc87a4f2298287b6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.786552:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100457.786554:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100457.786555:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790100457.786793:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff926084b41f80/2, rc 0, transno 4294967323 00000100:00100000:2.0:1790100457.786800:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141000320:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1790100457.788139:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1790100457.788154:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1790100457.788312:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127340160:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 2901us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.788322:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:2.0:1790100457.796197:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.796486:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127340416 00000100:00100000:0.0:1790100457.796497:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127340416 00000100:00100000:0.0:1790100457.796564:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:0.0:1790100457.796574:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+21:12466:x1877056127340416:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100457.796634:0:12139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100457.796682:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926800/0xc87a4f2298287b4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4af expref: 21 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.796703:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:0.0:1790100457.796709:0:12139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100457.796743:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.796757:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.796768:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100457.796893:0:12139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c328850f reply state 0000000094232aa7 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.796907:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.796914:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:0.0:1790100457.796917:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790100457.796919:0:12139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100457.797043:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+22:12466:x1877056127340416:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 469us (856us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1790100457.797051:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:2.0:1790100457.799369:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.799449:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127340544 00000100:00100000:3.0:1790100457.799459:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127340544 00000100:00100000:3.0:1790100457.799512:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:3.0:1790100457.799522:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127340544:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790100457.799668:0:10090:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790100457.799672:0:10090:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1790100457 -> 1790100456 00002000:00010000:3.0:1790100457.799674:0:10090:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1790100455 00002000:00010000:3.0:1790100457.799677:0:10090:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790100457 -> 1790100456 00002000:00010000:3.0:1790100457.799679:0:10090:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1790100457.799735:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127340544:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 214us (396us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1790100457.799743:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:2.0:1790100457.801609:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.801685:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127340800 00000100:00100000:1.0:1790100457.801693:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127340800 00000100:00100000:1.0:1790100457.801757:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:1.0:1790100457.801765:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+22:12466:x1877056127340800:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790100457.801831:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.801847:0:9338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.801856:0:9338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.801888:0:9338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.801914:0:9338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 22 pid: 6513 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.801927:0:9338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9338:1877056141000704:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100457.802013:0:9338:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6141000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100457.804314:0:9338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9338:1877056141000704:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100457.804369:0:9338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.815514:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.815596:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127340928 00000100:00100000:3.0:1790100457.815619:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127340928 00010000:00010000:3.0:1790100457.815659:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 23 pid: 6513 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.815706:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1790100457.815716:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+23:2422:x1877056127340928:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100457.815731:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100457.815738:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 23 pid: 6513 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.815752:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 23 pid: 6513 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.815776:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f2298287b32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a1 expref: 23 pid: 6513 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.815793:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:3.0:1790100457.815798:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.815808:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.815817:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.815850:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100457.815913:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+22:2422:x1877056127340928:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 198us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.815930:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00010000:00010000:2.0:1790100457.816229:0:9338:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.816238:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.816276:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.816283:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.816290:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.816296:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100457.816307:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.816315:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.816324:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:2.0:1790100457.816327:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790100457.816331:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.816391:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287b78 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.816444:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+21:12466:x1877056127340800:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 14679us (14841us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790100457.816453:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:2.0:1790100457.819208:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.819606:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127341056 00000100:00100000:0.0:1790100457.819616:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127341056 00000100:00100000:0.0:1790100457.819672:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1790100457.819683:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127341056:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790100457.819745:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.819764:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 8 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.819772:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100457.819777:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100457.819781:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.819812:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 8 pid: 10090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.819835:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 8 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.819848:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084919c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1877056141000832:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100457.819926:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100457.823065:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.824039:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084919c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1877056141000832:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100457.824067:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.831084:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127341184 00000100:00100000:1.0:1790100457.831109:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127341184 00010000:00010000:2.0:1790100457.837332:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 9 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.837406:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:2.0:1790100457.837417:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+9:2422:x1877056127341184:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100457.837433:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100457.837467:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 9 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.837480:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 9 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.837502:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d9b2dde/0xc87a4f2298287b5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4bd expref: 9 pid: 10090 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.837518:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100457.837522:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100457.837528:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.837538:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.837566:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100457.837633:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2422:x1877056127341184:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 218us (14575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.837641:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00010000:00010000:0.0:1790100457.837777:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.837788:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.837830:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.837840:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.837847:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.837855:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100457.837859:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.837868:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.837880:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.837887:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9b4dcf/0xc87a4f2298287b7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.837947:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127341056:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 18266us (18748us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.837964:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:2.0:1790100457.840459:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100457.840502:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127341440 00000100:00100000:1.0:1790100457.840511:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127341440 00000100:00100000:1.0:1790100457.840568:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:1.0:1790100457.840578:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+21:12466:x1877056127341440:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790100457.840668:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.840684:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.840693:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.840722:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.840735:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.840759:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056141000960:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100457.840845:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6141000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100457.843081:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.843160:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127341568 00000100:00100000:2.0:1790100457.843167:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127341568 00010000:00010000:2.0:1790100457.843203:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.843240:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:2.0:1790100457.843262:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+22:2422:x1877056127341568:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100457.843274:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100457.843281:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.843293:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.843314:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100457.843321:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.843330:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.843359:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.843367:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.843385:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100457.843427:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+22:2422:x1877056127341568:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 168us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.843434:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00010000:00010000:1.0:1790100457.846552:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298287a75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e469 expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.846577:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056141000960:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100457.846599:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.846609:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.846615:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.846794:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.846808:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.846829:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.846863:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.846877:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.846891:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056141001088:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100457.846987:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6141f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100457.850075:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.850201:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127341696 00000100:00100000:3.0:1790100457.850211:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127341696 00000100:00100000:1.0:1790100457.850226:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056141001088:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100457.850245:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.850249:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.850285:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:3.0:1790100457.850295:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+22:2422:x1877056127341696:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100457.850308:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100457.850315:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.850326:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.850369:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287b40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4a8 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.850395:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:3.0:1790100457.850401:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.850410:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.850418:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.850458:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100457.850510:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+21:2422:x1877056127341696:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 216us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.850517:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00010000:00010000:1.0:1790100457.851058:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.851067:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100457.851183:0:6512:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1790100457.851306:0:6512:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1790100457.851371:0:6512:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1790100457.851450:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877056141001216:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790100457.851500:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100457.851539:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100457.851568:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141001216 00000100:00100000:2.0:1790100457.851574:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141001216 00000100:00100000:2.0:1790100457.851619:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790100457.851637:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1877056141001216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790100457.851719:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1877056141001216:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.851725:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790100457.852214:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1790100457.852219:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:1.0:1790100457.852235:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff926084b40700, transno 4294967322 00000004:00080000:1.0:1790100457.852253:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff926084b41f80, transno 4294967323 00000100:00100000:1.0:1790100457.852260:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877056141001216:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1790100457.852416:0:6512:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1790100457.852470:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877056141001344:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790100457.852499:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100457.852523:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a6141000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100457.852534:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141001344 00000100:00100000:3.0:1790100457.852540:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141001344 00000100:00100000:3.0:1790100457.852574:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790100457.852581:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1877056141001344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790100457.852677:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1877056141001344:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (176us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1790100457.852684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790100457.852910:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084973800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877056141001344:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790100457.852940:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.852949:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.852963:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.852969:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100457.852973:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.852981:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853005:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:1.0:1790100457.853008:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100457.853014:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853020:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287b8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853040:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853047:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853053:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853059:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46800 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100457.853061:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853066:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853073:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100457.853075:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100457.853081:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853090:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.853114:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.858206:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.858231:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084918700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056141001472:192.168.203.13@tcp:105: 00000100:00100000:0.0:1790100457.858329:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992840 going to sleep for 11 seconds 00000100:00100000:2.0:1790100457.866132:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100457.866217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127341824 00000100:00100000:3.0:1790100457.866227:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127341824 00000100:00100000:3.0:1790100457.866280:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1790100457.866291:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a63fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12464:x1877056127341824:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:3.0:1790100457.866452:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+25:12464:x1877056127341824:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 154us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.866460:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1790100457.867287:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084918700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877056141001472:192.168.203.13@tcp:105: 00010000:00010000:0.0:1790100457.867314:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867327:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ad0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867401:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867416:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867427:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867437:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867444:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867451:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867456:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.867473:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867482:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867494:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100457.867507:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.867513:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867519:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b94 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867529:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867535:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867541:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867546:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ea00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.867548:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867554:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867562:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100457.867564:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790100457.867574:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.867580:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287b86 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100457.867846:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100457.867851:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100457.868371:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790100457.868380:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100457.868745:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a63fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12466:x1877056127341440:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 28162us (28289us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1790100457.868756:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 245 00000020:00080000:0.0:1790100457.868761:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790100457.878205:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.878432:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127342080 00000100:00100000:0.0:1790100457.878442:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127342080 00000100:00100000:0.0:1790100457.878509:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:0.0:1790100457.878522:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12464:x1877056127342080:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:0.0:1790100457.878679:0:12139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1790100457.878746:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12464:x1877056127342080:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 227us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.878753:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:3.0:1790100457.880425:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.880632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127342336 00000100:00100000:0.0:1790100457.880640:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127342336 00000100:00100000:0.0:1790100457.880684:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:0.0:1790100457.880692:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+24:12466:x1877056127342336:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790100457.880939:0:6515:0:(mdd_object.c:4178:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790100457.880975:0:6515:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1790100457.881003:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.881018:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.881045:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.881054:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.881060:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.881067:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.881086:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790100457.881161:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+26:12466:x1877056127342336:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 469us (742us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1790100457.881169:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000020:00080000:0.0:1790100457.881173:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100457.881725:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100457.881733:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.881740:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100457.881744:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.881753:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.881765:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:2.0:1790100457.881768:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790100457.881773:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.881779:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287b9b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.881791:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100457.881799:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100457.881801:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100457.928592:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260849c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141001600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100457.928667:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100457.928786:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141001600 00000100:00100000:3.0:1790100457.928794:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141001600 00000100:00100000:3.0:1790100457.928869:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790100457.928879:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056141001600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100457.928907:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790100457.929408:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141002112:0@lo:400:kworker.0 00000100:00100000:2.0:1790100457.929444:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100457.929561:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056141001600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 683us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.929579:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790100457.929635:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056141001984:0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.929669:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100457.929690:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100457.929695:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260849c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056141001856:0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.929719:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100457.929752:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141001728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100457.929775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100457.929800:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141001728 00000100:00100000:3.0:1790100457.929804:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141001728 00000100:00100000:3.0:1790100457.929996:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790100457.930016:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141001728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790100457.930034:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790100457.930070:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141001728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.930076:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1790100457.930092:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100457.930125:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141001728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100457.930162:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141002112 00000100:00100000:3.0:1790100457.930166:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141002112 00000100:00100000:3.0:1790100457.930191:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790100457.930197:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141002112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.930242:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141002112:12345-0@lo:400:kworker.0 Request processed in 45us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.930248:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790100457.930284:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141001984 00000100:00100000:3.0:1790100457.930287:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141001984 00000100:00100000:2.0:1790100457.930398:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260849c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141001600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100457.930420:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141002112:0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.930518:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790100457.930526:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056141001984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.930563:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056141001984:12345-0@lo:400:kworker.0 Request processed in 38us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.930570:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790100457.930596:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056141001984:0@lo:400:kworker.0 00000100:00100000:0.0:1790100457.930697:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141001856 00000100:00100000:0.0:1790100457.930701:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141001856 00000100:00100000:0.0:1790100457.930730:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1790100457.930737:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056141001856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100457.930778:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056141001856:12345-0@lo:400:kworker.0 Request processed in 42us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.930784:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1790100457.930817:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260849c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056141001856:0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.931564:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608491b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056141002240:0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.931597:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100457.931655:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141002240 00000100:00100000:1.0:1790100457.931659:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141002240 00000100:00100000:1.0:1790100457.931692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790100457.931699:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056141002240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100457.931848:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056141002624:0@lo:400:kworker.0 00000100:00100000:2.0:1790100457.931875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100457.931903:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141002624 00000100:00100000:2.0:1790100457.931906:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141002624 00000100:00080000:2.0:1790100457.931923:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790100457.931946:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790100457.931964:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056141002624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100457.931996:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056141002624:12345-0@lo:400:kworker.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.932001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:2.0:1790100457.932029:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926084919180 x1877056141002624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100457.932040:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056141002624:0@lo:400:kworker.0 00000100:00100000:1.0:1790100457.932327:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056141002240:12345-0@lo:400:kworker.0 Request processed in 629us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.932334:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790100457.932450:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141002368:0@lo:400:kworker.0 00000100:00100000:1.0:1790100457.932479:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100457.932504:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100457.932510:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056141002496:0@lo:400:kworker.0 00000100:00100000:1.0:1790100457.932530:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100457.932585:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141002368 00000100:00100000:2.0:1790100457.932590:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141002368 00000100:00100000:2.0:1790100457.932622:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790100457.932629:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141002368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100457.932680:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141002368:12345-0@lo:400:kworker.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.932686:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790100457.932703:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141002496 00000100:00100000:2.0:1790100457.932706:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141002496 00000100:00100000:2.0:1790100457.932730:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790100457.932736:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056141002496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100457.932762:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056141002496:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.932767:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:2.0:1790100457.932781:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100457.932967:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056141002496:0@lo:400:kworker.0 00000100:00100000:1.0:1790100457.932978:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141002368:0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.933050:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608491b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056141002240:0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.933197:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608491a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141002752:0@lo:400:kworker.0 00000100:00100000:3.0:1790100457.933236:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100457.933371:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608491b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056141002880:0@lo:400:kworker.0 00000100:00100000:0.0:1790100457.933398:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100457.933426:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100457.933432:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141003008:0@lo:400:kworker.0 00000100:00100000:0.0:1790100457.933452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100457.933477:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141002880 00000100:00100000:0.0:1790100457.933481:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141002880 00000100:00100000:0.0:1790100457.933509:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141003008 00000100:00100000:0.0:1790100457.933512:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141003008 00000100:00100000:0.0:1790100457.933531:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790100457.933537:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056141002880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100457.933588:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056141002880:12345-0@lo:400:kworker.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.933594:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790100457.933606:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790100457.933612:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056141003008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100457.933636:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056141003008:12345-0@lo:400:kworker.0 Request processed in 25us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.933642:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1790100457.933654:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100457.933657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790100457.933677:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926084919880 x1877056141003008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100457.933687:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141003008:0@lo:400:kworker.0 00000100:00100000:0.0:1790100457.933696:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608491b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056141002880:0@lo:400:kworker.0 00000100:00100000:2.0:1790100457.934119:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141002752 00000100:00100000:2.0:1790100457.934124:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141002752 00000100:00100000:2.0:1790100457.934173:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790100457.934179:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141002752:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790100457.934239:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100457.934377:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141002752:12345-0@lo:400:kworker.0 Request processed in 198us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.934384:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790100457.934468:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608491a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141002752:0@lo:400:kworker.0 00000100:00100000:2.0:1790100457.977019:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.977223:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127342464 00000100:00100000:0.0:1790100457.977234:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127342464 00000100:00100000:0.0:1790100457.977293:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:0.0:1790100457.977315:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+26:12468:x1877056127342464:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100457.977375:0:12139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100457.977395:0:12139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ba2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4c4 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977458:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977482:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977492:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977504:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977511:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977516:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977579:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977589:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977598:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977652:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.977665:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 27 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.977677:0:12139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608491b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056141003136:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100457.977757:0:12139:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100457.986243:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100457.986796:0:12139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608491b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12139:1877056141003136:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100457.986821:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.986892:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127342720 00000100:00100000:1.0:1790100457.986907:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127342720 00000100:00100000:1.0:1790100457.986984:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1790100457.986994:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+28:6181:x1877056127342720:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790100457.987213:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+29:6181:x1877056127342720:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 220us (977us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1790100457.987220:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1790100457.992334:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100457.992544:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127342848 00000100:00100000:2.0:1790100457.992554:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127342848 00010000:00010000:2.0:1790100457.992594:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 29 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.992630:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:2.0:1790100457.992640:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184252450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+29:2421:x1877056127342848:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100457.992654:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100457.992676:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 29 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.992689:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 29 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.992711:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47e00/0xc87a4f2298287ac2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e485 expref: 29 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.992727:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100457.992732:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.992742:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.992750:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.992773:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100457.992834:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184252450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+28:2421:x1877056127342848:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 196us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.992842:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00010000:00010000:0.0:1790100457.993510:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993522:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100457.993574:0:12139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790100457.993579:0:12139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100457.993599:0:12139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993613:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993622:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993640:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993647:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993653:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.993658:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993666:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993678:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:0.0:1790100457.993681:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.993684:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993690:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298287ba9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993702:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993708:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993714:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993719:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100457.993729:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993736:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993744:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9261c1af1f00) 00010000:00010000:0.0:1790100457.993747:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.993750:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993756:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f2298287bb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993793:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298287ba2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4c4 expref: 28 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993806:0:12139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4c4 expref: 27 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.993813:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100457.993815:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100457.993818:0:12139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:0.0:1790100457.993856:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12468:x1877056127342464:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 16542us (16847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.993864:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 247 00010000:00010000:0.0:1790100458.314272:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100458.889552:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100458.889561:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100458.889587:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790100458.889596:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100458.889787:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260849c9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056141003264:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790100458.889879:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100458.898300:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100458.898482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127342976 00000100:00100000:2.0:1790100458.898501:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127342976 00000100:00100000:2.0:1790100458.898560:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:2.0:1790100458.898570:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+28:12479:x1877056127342976:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790100458.898606:0:6514:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790100458.898715:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+28:12479:x1877056127342976:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 146us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100458.898724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:3.0:1790100458.899898:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260849c9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1877056141003264:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790100458.902621:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100458.902835:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127343232 00000100:00100000:1.0:1790100458.902845:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127343232 00000100:00100000:1.0:1790100458.902908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:1.0:1790100458.902918:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+27:12479:x1877056127343232:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100458.902956:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100458.902977:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287bbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.903081:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287bc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.903097:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.903111:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100458.903122:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790100458.903237:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f2298287bbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4cb expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.903256:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4cb expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.903264:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100458.903267:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100458.903272:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8ea00, rc 0) 00000100:00100000:1.0:1790100458.903334:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+29:12479:x1877056127343232:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 416us (721us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1790100458.903382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:2.0:1790100458.923861:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100458.927382:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100458.927437:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127343616 00000100:00100000:2.0:1790100458.927446:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127343616 00000100:00100000:2.0:1790100458.927504:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 250 00000100:00100000:2.0:1790100458.927516:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608492e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+29:12479:x1877056127343616:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790100458.927610:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927630:0:12139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927642:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927787:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927795:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927801:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927814:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100458.927818:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927826:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927837:0:12139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100458.927839:0:12139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100458.927844:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100458.927850:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bd3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100458.927982:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608492e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12479:x1877056127343616:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 467us (609us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1790100458.927990:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 250 00000040:00080000:2.0:1790100458.928139:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100458.928143:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100458.928648:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790100458.928656:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790100458.935835:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100458.936067:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127343872 00000100:00100000:1.0:1790100458.936077:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127343872 00000100:00100000:1.0:1790100458.936138:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1790100458.936149:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12479:x1877056127343872:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790100458.936451:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+31:12479:x1877056127343872:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 303us (624us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1790100458.936623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1790100458.938020:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127343360 00000100:00100000:0.0:1790100458.938030:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127343360 00000100:00100000:0.0:1790100458.938083:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1790100458.938101:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260849c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+31:2421:x1877056127343360:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100458.938114:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100458.938135:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ea00/0xc87a4f2298287bc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4cb expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100458.938154:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:0.0:1790100458.938158:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100458.938200:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260849c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+30:2421:x1877056127343360:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 100us (14346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100458.938207:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000040:00080000:2.0:1790100459.037102:0:14794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100459.037110:0:14794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100459.037152:0:14794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790100459.037158:0:14794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790100459.310298:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100459.310412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127344128 00000100:00100000:1.0:1790100459.310422:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127344128 00000100:00100000:1.0:1790100459.310551:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00080000:0.0:1790100459.310561:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100459.310575:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+30:12492:x1877056127344128:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100459.310599:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100459.310617:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287bda lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100459.310736:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287be1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100459.310748:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287be1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100459.310760:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287be1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100459.310769:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790100459.310848:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f2298287bda lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4d2 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100459.310884:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287be1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4d2 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100459.310890:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100459.310892:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790100459.310896:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e200, rc 0) 00000100:00100000:1.0:1790100459.310979:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+32:12492:x1877056127344128:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 409us (691us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790100459.310987:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00100000:0.0:1790100459.319657:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100459.320599:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127344256 00000100:00100000:2.0:1790100459.320611:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127344256 00000100:00100000:2.0:1790100459.320677:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 252 00000100:00100000:2.0:1790100459.320711:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608491b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+32:12492:x1877056127344256:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790100459.321000:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321018:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321032:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321080:0:9338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321088:0:9338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321094:0:9338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321100:0:9338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100459.321105:0:9338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321112:0:9338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321123:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:2.0:1790100459.321126:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100459.321131:0:9338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100459.321137:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927600/0xc87a4f2298287bef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100459.321403:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608491b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+32:12492:x1877056127344256:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 693us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100459.321412:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 252 00010000:00010000:2.0:1790100459.339731:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100459.417042:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100459.417161:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127344384 00000100:00100000:1.0:1790100459.417172:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127344384 00000100:00100000:1.0:1790100459.417246:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1790100459.417262:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127344384:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1790100459.417282:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100459.417304:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298287bf6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4d9 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100459.417327:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6ab2c3e8, atime: 0x6ab2c3e7, ctime: 0x6ab2c3e8, blocks: 0x8 00010000:00010000:1.0:1790100459.417381:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=310s v=(0 0) 00010000:00010000:1.0:1790100459.417386:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100459.417395:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298287bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4d9 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100459.417412:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298287bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4d9 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100459.417445:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e800, rc 0) 00000100:00100000:1.0:1790100459.417497:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2419:x1877056127344384:12345-192.168.203.13@tcp:101:cat.0 Request processed in 238us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100459.417504:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00080000:0.0:1790100459.417822:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100459.421618:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100459.421728:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127344512 00000100:00100000:2.0:1790100459.421739:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127344512 00002000:00100000:2.0:1790100459.421789:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff926084b41c00 x1877056127344512/t0(0) o3->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:0/0 lens 488/0 e 0 to 0 dl 1790100470 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100459.421801:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926084b41c00 with x1877056127344512 ext(0->4095) 00002000:00010000:2.0:1790100459.421807:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926084b41c00 00000100:00100000:2.0:1790100459.421849:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790100459.421860:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2419:x1877056127344512:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:2.0:1790100459.422189:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2419:x1877056127344512:12345-192.168.203.13@tcp:3:cat.0 Request processed in 330us (578us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790100459.422198:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00002000:00100000:2.0:1790100459.422205:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff926084b41c00 x1877056127344512/t0(0) o3->e84eb833-b466-4273-a7db-c12bb35adfb4@192.168.203.13@tcp:0/0 lens 488/4536 e 0 to 0 dl 1790100470 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100459.422213:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff926084b41c00 with x1877056127344512 ext(0->4095) 00002000:00010000:2.0:1790100459.422216:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff926084b41c00 00000100:00100000:3.0:1790100459.868117:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100459.868154:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100459.868254:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127344768 00000100:00100000:2.0:1790100459.868265:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127344768 00000100:00100000:2.0:1790100459.868334:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 265 00000100:00100000:2.0:1790100459.868380:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+32:2420:x1877056127344768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100459.868453:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+32:2420:x1877056127344768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100459.868473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 265 00000100:00100000:3.0:1790100459.868986:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100459.869040:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100459.869071:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100459.869113:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100459.869168:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127345280 00000100:00100000:2.0:1790100459.869173:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127345280 00000100:00100000:0.0:1790100459.869442:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127344896 00000100:00100000:0.0:1790100459.869453:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127344896 00000100:00100000:0.0:1790100459.869498:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 266 00000100:00100000:0.0:1790100459.869512:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127344896:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100459.869567:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2420:x1877056127344896:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 61us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100459.869573:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 266 00000100:00080000:0.0:1790100459.869605:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100459.869691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127344640 00000100:00100000:0.0:1790100459.869706:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127344640 00000100:00100000:0.0:1790100459.869730:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 374 00000100:00100000:0.0:1790100459.869737:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127344640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100459.869772:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926191278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2420:x1877056127344640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100459.869790:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 374 00000100:00100000:2.0:1790100459.870125:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 267 00000100:00100000:2.0:1790100459.870132:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127345280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100459.870172:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127345280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100459.870186:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 267 00000100:00080000:0.0:1790100459.870373:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100459.873288:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100459.873513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127345408 00000100:00100000:0.0:1790100459.873531:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127345408 00000100:00100000:0.0:1790100459.873641:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:0.0:1790100459.873651:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127345408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100459.873764:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127345408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 114us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100459.873772:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00080000:3.0:1790100459.874556:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100459.874808:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127345024 00000100:00100000:1.0:1790100459.874816:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127345024 00000100:00100000:1.0:1790100459.874868:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127345152 00000100:00100000:1.0:1790100459.874872:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127345152 00000100:00100000:1.0:1790100459.878823:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1790100459.878842:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2420:x1877056127345024:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:3.0:1790100459.879090:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100459.879309:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+8:2420:x1877056127345024:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 472us (11151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100459.879317:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1790100459.879359:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1790100459.879367:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2420:x1877056127345152:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100459.879395:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2420:x1877056127345152:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (10282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100459.879402:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00010000:00010000:1.0:1790100460.363779:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100461.001655:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100461.001732:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141003392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100461.001800:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100461.001907:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141003392 00000100:00100000:2.0:1790100461.001915:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141003392 00000100:00100000:2.0:1790100461.001981:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790100461.001991:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1877056141003392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100461.002020:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790100461.002066:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1877056141003392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100461.002073:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1790100461.002133:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100461.002184:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141003392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100461.005868:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141003520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100461.005945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100461.006034:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141003520 00000100:00100000:3.0:1790100461.006043:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141003520 00000100:00100000:3.0:1790100461.006109:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790100461.006118:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141003520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100461.006140:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790100461.006201:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141003520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100461.006208:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790100461.006258:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141003520:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790100461.006444:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100461.384570:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100462.024689:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141003648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100462.024785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100462.024868:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141003648 00000100:00100000:3.0:1790100462.024875:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141003648 00000100:00100000:3.0:1790100462.024939:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790100462.024949:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141003648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100462.024998:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790100462.025058:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141003648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100462.025067:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790100462.025114:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141003648:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790100462.417206:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100462.540040:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100462.540064:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141003776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100462.540193:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100462.540261:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141003776 00000100:00100000:2.0:1790100462.540268:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141003776 00000100:00100000:2.0:1790100462.540312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790100462.540329:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141003776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100462.540377:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100462.540422:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141003776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100462.540429:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790100462.540490:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141003776:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1790100462.544645:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1790100462.544659:0:9503:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:2.0:1790100462.985178:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790100463.054024:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100463.054032:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100463.054074:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790100463.054082:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100463.054144:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141003904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100463.054263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141004416:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054400:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141004928:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054478:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141005440:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054498:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054518:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1790100463.054531:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141004032:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054560:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054582:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141004544:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054603:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054620:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141005056:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054656:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141005568:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054674:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054703:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141004160:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054746:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054764:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608491a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056141004672:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054783:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054798:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056141005184:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054813:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054827:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790100463.054832:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608491aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141004288:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054847:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054860:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141004800:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054878:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054892:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141005312:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.054914:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100463.054947:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141003904 00000100:00100000:0.0:1790100463.054954:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141003904 00000100:00100000:0.0:1790100463.055004:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790100463.055012:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260848c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141003904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100463.055054:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100463.055093:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260848c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141003904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100463.055100:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790100463.055118:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141004416 00000100:00100000:0.0:1790100463.055121:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141004416 00000100:00100000:0.0:1790100463.055137:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141004160 00000100:00100000:0.0:1790100463.055139:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141004160 00000100:00100000:0.0:1790100463.055148:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141004672 00000100:00100000:0.0:1790100463.055149:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141004672 00000100:00100000:0.0:1790100463.055159:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141005184 00000100:00100000:0.0:1790100463.055160:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141005184 00000100:00100000:0.0:1790100463.055168:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141004800 00000100:00100000:0.0:1790100463.055170:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141004800 00000100:00100000:0.0:1790100463.055179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141005312 00000100:00100000:0.0:1790100463.055181:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141005312 00000100:00100000:0.0:1790100463.055191:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790100463.055196:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141004416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.055223:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141004416:12345-0@lo:400:kworker.0 Request processed in 27us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100463.055228:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790100463.055237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790100463.055242:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141004160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.055267:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141004160:12345-0@lo:400:kworker.0 Request processed in 25us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100463.055273:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790100463.055283:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1790100463.055288:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056141004672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.055322:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056141004672:12345-0@lo:400:kworker.0 Request processed in 34us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100463.055328:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1790100463.055361:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1790100463.055367:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056141005184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.055394:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056141005184:12345-0@lo:400:kworker.0 Request processed in 28us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100463.055400:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1790100463.055411:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790100463.055417:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141004800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.055443:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141004800:12345-0@lo:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100463.055448:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790100463.055459:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790100463.055464:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b20cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056141005312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.055488:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b20cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056141005312:12345-0@lo:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100463.055493:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790100463.056794:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141004032 00000100:00100000:0.0:1790100463.056805:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141004032 00000100:00100000:0.0:1790100463.056846:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1790100463.056855:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141004032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.056909:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92619127a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141004032:12345-0@lo:400:kworker.0 Request processed in 56us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100463.058026:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100463.058045:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141005696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100463.058090:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100463.058141:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141004928 00000100:00100000:1.0:1790100463.058147:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141004928 00000100:00100000:1.0:1790100463.058189:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141005440 00000100:00100000:1.0:1790100463.058192:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141005440 00000100:00100000:1.0:1790100463.058204:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141005056 00000100:00100000:1.0:1790100463.058207:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141005056 00000100:00100000:1.0:1790100463.058219:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141005568 00000100:00100000:1.0:1790100463.058221:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141005568 00000100:00100000:1.0:1790100463.058236:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790100463.058243:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141004928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100463.058286:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141004928:12345-0@lo:400:kworker.0 Request processed in 43us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100463.058293:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790100463.058309:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790100463.058315:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141005440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100463.058365:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141005440:12345-0@lo:400:kworker.0 Request processed in 49us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100463.058371:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790100463.058382:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790100463.058388:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056141005056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100463.058415:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056141005056:12345-0@lo:400:kworker.0 Request processed in 27us (3773us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100463.058421:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790100463.058431:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790100463.058437:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141005568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100463.058472:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141005568:12345-0@lo:400:kworker.0 Request processed in 24us (3785us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100463.058479:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790100463.058612:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141005696 00000100:00100000:3.0:1790100463.058617:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141005696 00000100:00100000:3.0:1790100463.058653:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790100463.058661:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141005696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100463.058676:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100463.058713:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141005696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100463.058720:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790100463.058750:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1790100463.058756:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1790100463.058783:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9261a63ff100, transno 4294967311 00000100:00100000:3.0:1790100463.058802:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141005696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100463.059585:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141004544 00000100:00100000:1.0:1790100463.059599:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141004544 00000100:00100000:1.0:1790100463.059635:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141004288 00000100:00100000:1.0:1790100463.059638:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141004288 00000100:00100000:1.0:1790100463.059653:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790100463.059660:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141004544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100463.059714:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141004544:12345-0@lo:400:kworker.0 Request processed in 53us (5108us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100463.059720:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790100463.059734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790100463.059739:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141004288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100463.059767:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141004288:12345-0@lo:400:kworker.0 Request processed in 28us (4919us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100463.059772:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000001:00080000:1.0:1790100463.064686:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1790100463.064717:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff926083d55e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1790100463.064722:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083b92b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff926083d55600 00000020:00080000:1.0:1790100463.064727:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff926083b92a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff926084bb9800 00000020:00080000:1.0:1790100463.064741:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:0.0:1790100463.064806:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:0.0:1790100463.064879:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100463.064885:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790100463.064888:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100463.064891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790100463.065178:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100463.065192:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100463.065202:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100463.065209:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100463.065221:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100463.065229:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100463.065249:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff926190155a00) 00010000:00010000:3.0:1790100463.065251:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100463.065257:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100463.065264:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298287b71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12139 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790100463.065305:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1790100463.065400:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1790100463.065712:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608491aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141004288:0@lo:400:kworker.0 00010000:00080000:0.0:1790100463.065729:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926084972680 x1877056141004800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100463.065739:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141004800:0@lo:400:kworker.0 00010000:00080000:0.0:1790100463.065752:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a63fed80 x1877056141005312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100463.065760:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141005312:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.065773:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141004160:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.065785:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608491a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056141004672:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.065797:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056141005184:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.066042:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141004032:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.066059:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141004544:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.066074:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141005056:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.066087:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141005568:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.066112:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141003904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100463.066125:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141004416:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.066137:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141004928:0@lo:400:kworker.0 00000100:00100000:0.0:1790100463.066160:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a63ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141005440:0@lo:400:kworker.0 00010000:00010000:1.0:1790100463.432643:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790100463.569835:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1790100463.569849:0:8420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:1.0:1790100464.467600:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100464.984800:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100464.984858:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100464.984892:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100464.984926:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100464.984959:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100464.984980:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100464.985003:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100464.985212:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127345536 00000100:00100000:1.0:1790100464.985222:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127345536 00000100:00100000:1.0:1790100464.985269:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 376 00000100:00100000:1.0:1790100464.985279:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127345536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100464.985368:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2422:x1877056127345536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100464.985389:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 376 00000100:00100000:3.0:1790100464.985481:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127346048 00000100:00100000:3.0:1790100464.985485:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127346048 00000100:00100000:3.0:1790100464.985527:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127345920 00000100:00100000:3.0:1790100464.985530:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127345920 00000100:00100000:3.0:1790100464.985551:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:3.0:1790100464.985558:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127346048:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100464.985595:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127346048:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100464.985601:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:3.0:1790100464.985614:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1790100464.985620:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127345920:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100464.985645:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2422:x1877056127345920:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100464.985650:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1790100464.985665:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127345792 00000100:00100000:3.0:1790100464.985668:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127345792 00000100:00100000:3.0:1790100464.985689:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127346304 00000100:00100000:3.0:1790100464.985691:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127346304 00000100:00100000:3.0:1790100464.985702:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127345664 00000100:00100000:3.0:1790100464.985704:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127345664 00000100:00100000:3.0:1790100464.985715:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127346176 00000100:00100000:3.0:1790100464.985717:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127346176 00000100:00100000:3.0:1790100464.985729:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:3.0:1790100464.985734:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127345792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100464.985761:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2422:x1877056127345792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100464.985767:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:3.0:1790100464.985778:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:3.0:1790100464.985785:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127346304:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100464.985806:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127346304:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100464.985822:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:3.0:1790100464.985835:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 277 00000100:00100000:3.0:1790100464.985841:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2422:x1877056127345664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100464.985868:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2422:x1877056127345664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100464.985874:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 277 00000100:00100000:3.0:1790100464.985900:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:3.0:1790100464.985916:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127346176:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:1.0:1790100464.986382:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790100464.986388:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100464.986390:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100464.986392:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100464.986582:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2422:x1877056127346176:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 665us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100464.986590:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:3.0:1790100465.354432:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100465.354756:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127346432 00000100:00100000:1.0:1790100465.354767:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127346432 00000100:00100000:1.0:1790100465.354832:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 253 00000100:00100000:1.0:1790100465.354842:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+18:12145:x1877056127346432:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790100465.354960:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+18:12145:x1877056127346432:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 119us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100465.354968:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 253 00000100:00100000:0.0:1790100465.363769:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100465.367636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127346560 00000100:00100000:3.0:1790100465.367651:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127346560 00000100:00100000:3.0:1790100465.367767:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 254 00000100:00100000:3.0:1790100465.367778:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:12145:x1877056127346560:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790100465.368987:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+5:12145:x1877056127346560:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 1205us (5222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100465.368998:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 254 00000100:00100000:0.0:1790100465.381180:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100465.388160:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127346816 00000100:00100000:3.0:1790100465.388174:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127346816 00000100:00100000:2.0:1790100465.388394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:2.0:1790100465.388405:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+18:12145:x1877056127346816:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790100465.388635:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+19:12145:x1877056127346816:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 231us (7465us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1790100465.388643:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00010000:00010000:2.0:1790100465.480568:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100466.120662:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100466.120685:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141005824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100466.120753:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100466.120827:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100466.120846:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141005952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100466.120881:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100466.121023:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141005824 00000100:00100000:2.0:1790100466.121031:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141005824 00000100:00100000:2.0:1790100466.121091:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141005952 00000100:00100000:2.0:1790100466.121094:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141005952 00000100:00100000:2.0:1790100466.121111:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790100466.121119:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141005824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790100466.121144:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790100466.121196:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141005824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100466.121216:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790100466.121232:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790100466.121238:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141005952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100466.121264:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790100466.121291:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141005952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100466.121298:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790100466.121327:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1790100466.121332:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1790100466.121388:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141005952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100466.121415:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141005824:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790100466.121673:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790100466.504572:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100467.157409:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100467.157430:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141006080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100467.157588:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100467.157705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141006080 00000100:00100000:2.0:1790100467.157713:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141006080 00000100:00100000:2.0:1790100467.157764:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790100467.157773:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141006080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100467.157802:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1790100467.157966:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141006080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 194us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100467.157974:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790100467.158020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141006080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790100467.539074:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100467.669541:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141006208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100467.669614:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100467.669730:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141006208 00000100:00100000:3.0:1790100467.669739:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141006208 00000100:00100000:3.0:1790100467.669792:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790100467.669803:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141006208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790100467.669864:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790100467.669930:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141006208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100467.669937:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790100467.669980:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141006208:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1790100468.109841:0:14991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:07:45 (1790100465) 00000100:00100000:2.0:1790100468.174697:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141006336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100468.174768:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100468.174864:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141006336 00000100:00100000:2.0:1790100468.174872:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141006336 00000100:00100000:2.0:1790100468.174941:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790100468.174951:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141006336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100468.174995:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100468.175053:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141006336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100468.175060:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790100468.175179:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141006336:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790100468.175915:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100468.176042:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141006464:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176081:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100468.176112:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141006976:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100468.176157:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141007488:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176179:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100468.176186:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141006464 00000100:00100000:1.0:1790100468.176191:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141006464 00000100:00100000:0.0:1790100468.176199:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790100468.176205:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141006592:0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.176221:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1790100468.176227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100468.176228:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141006464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176242:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141007104:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100468.176265:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141006464:12345-0@lo:400:kworker.0 Request processed in 38us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100468.176272:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1790100468.176272:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141007616:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100468.176309:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141006464:0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.176400:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141007488 00000100:00100000:1.0:1790100468.176404:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141007488 00000100:00100000:1.0:1790100468.176433:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790100468.176433:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141006720:0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.176446:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141007488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176457:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100468.176475:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141007232:0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.176477:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141007488:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100468.176483:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790100468.176493:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100468.176501:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141006976 00000100:00100000:1.0:1790100468.176505:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141006976 00000100:00100000:0.0:1790100468.176507:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141007744:0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.176524:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141006720 00000100:00100000:0.0:1790100468.176526:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100468.176527:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141006720 00000100:00100000:1.0:1790100468.176539:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790100468.176541:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790100468.176545:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141006976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176546:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056141006848:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176565:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100468.176572:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141006976:12345-0@lo:400:kworker.0 Request processed in 28us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100468.176574:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141007360:0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.176578:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790100468.176590:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790100468.176591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100468.176595:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141006720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.176607:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141007872:0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.176620:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141006720:12345-0@lo:400:kworker.0 Request processed in 26us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100468.176626:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790100468.176640:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100468.176655:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141007360 00000100:00100000:1.0:1790100468.176658:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141007360 00000100:00100000:1.0:1790100468.176683:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141007872 00000100:00100000:1.0:1790100468.176686:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141007872 00000100:00100000:1.0:1790100468.176700:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790100468.176705:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141007360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100468.180054:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141006592 00000100:00100000:3.0:1790100468.180067:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141006592 00000100:00100000:3.0:1790100468.180102:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141007104 00000100:00100000:3.0:1790100468.181799:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141007104 00000100:00100000:3.0:1790100468.181856:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141007616 00000100:00100000:3.0:1790100468.181858:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141007616 00000100:00100000:3.0:1790100468.181871:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141007232 00000100:00100000:3.0:1790100468.181873:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141007232 00000100:00100000:3.0:1790100468.181895:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141007744 00000100:00100000:3.0:1790100468.181898:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141007744 00000100:00100000:3.0:1790100468.181907:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141006848 00000100:00100000:3.0:1790100468.181910:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141006848 00000100:00100000:3.0:1790100468.181924:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1790100468.181933:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141006592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.182988:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141007360:12345-0@lo:400:kworker.0 Request processed in 6279us (6392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100468.183000:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790100468.183035:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790100468.183044:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141007872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100468.183080:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141007872:12345-0@lo:400:kworker.0 Request processed in 39us (6440us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100468.183086:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1790100468.192252:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100468.192262:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100468.192265:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100468.192268:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100468.192301:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141008000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100468.192394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100468.192482:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141006976:0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.192497:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141007488:0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.192535:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141008000 00000100:00100000:2.0:1790100468.192540:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141008000 00000100:00100000:2.0:1790100468.192580:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790100468.192588:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141008000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790100468.192609:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100468.192662:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141008000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100468.192669:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790100468.192706:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141008000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100468.194401:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1790100468.194420:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141007104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.198620:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141007104:12345-0@lo:400:kworker.0 Request processed in 4201us (22352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100468.200912:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1790100468.200955:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790100468.200970:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056141007616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.201049:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056141007616:12345-0@lo:400:kworker.0 Request processed in 85us (24759us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100468.201055:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790100468.201069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790100468.201076:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141007232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.201104:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141007232:12345-0@lo:400:kworker.0 Request processed in 29us (24609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100468.201122:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790100468.201134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790100468.201141:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056141007744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.201167:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056141007744:12345-0@lo:400:kworker.0 Request processed in 27us (24640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100468.201172:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790100468.201182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1790100468.201188:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056141006848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.201215:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056141006848:12345-0@lo:400:kworker.0 Request processed in 27us (24649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100468.201221:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1790100468.201296:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141007104:0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.201331:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141007616:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.205550:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141006720:0@lo:400:kworker.0 00010000:00080000:0.0:1790100468.205570:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92608497df80 x1877056141007232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100468.205581:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141007232:0@lo:400:kworker.0 00010000:00080000:0.0:1790100468.205592:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261c1b42300 x1877056141007744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100468.205600:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141007744:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.205634:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056141006848:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.205644:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141007360:0@lo:400:kworker.0 00000100:00100000:0.0:1790100468.205665:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141007872:0@lo:400:kworker.0 00000100:00100000:2.0:1790100468.221864:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141006592:12345-0@lo:400:kworker.0 Request processed in 39924us (45627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100468.221890:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1790100468.222812:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141006592:0@lo:400:kworker.0 00010000:00010000:2.0:1790100468.557203:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790100468.699638:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1790100468.699652:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1790100468.699707:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1790100468.699719:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790100469.576554:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100470.104261:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100470.104303:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100470.104372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100470.104401:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100470.104433:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100470.104452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100470.104475:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100470.104512:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127347328 00000100:00100000:2.0:1790100470.104521:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127347328 00000100:00100000:2.0:1790100470.104573:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127347456 00000100:00100000:2.0:1790100470.104576:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127347456 00000100:00100000:2.0:1790100470.104597:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1790100470.104607:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127347328:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.104672:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2419:x1877056127347328:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.104679:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1790100470.104696:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1790100470.104703:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127347456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.104725:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127347456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.104731:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1790100470.104766:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127347072 00000100:00100000:2.0:1790100470.104769:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127347072 00000100:00100000:2.0:1790100470.104797:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 285 00000100:00100000:2.0:1790100470.104816:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2419:x1877056127347072:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.104906:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+18:2419:x1877056127347072:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.104913:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 285 00000100:00100000:2.0:1790100470.104940:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127347584 00000100:00100000:2.0:1790100470.104944:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127347584 00000100:00100000:2.0:1790100470.104972:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127347200 00000100:00100000:2.0:1790100470.104975:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127347200 00000100:00100000:2.0:1790100470.105003:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127347712 00000100:00100000:2.0:1790100470.105006:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127347712 00000100:00100000:2.0:1790100470.105023:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:2.0:1790100470.105029:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127347584:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.105054:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127347584:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.105060:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:2.0:1790100470.105072:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 287 00000100:00100000:2.0:1790100470.105079:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127347200:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.105102:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2419:x1877056127347200:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.105108:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 287 00000100:00100000:2.0:1790100470.105119:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:2.0:1790100470.105125:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127347712:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.105148:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2419:x1877056127347712:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.105159:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:2.0:1790100470.105196:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127346944 00000100:00100000:2.0:1790100470.105200:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127346944 00000100:00100000:2.0:1790100470.105246:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 378 00000100:00100000:2.0:1790100470.105252:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2419:x1877056127346944:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.105277:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2419:x1877056127346944:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.105284:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 378 00000100:00080000:2.0:1790100470.105399:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100470.105403:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100470.105405:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100470.105407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100470.601776:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100470.843180:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100470.843287:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127347840 00000100:00100000:2.0:1790100470.843298:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127347840 00000100:00100000:2.0:1790100470.843413:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 255 00000100:00100000:2.0:1790100470.843424:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:13164:x1877056127347840:12345-192.168.203.13@tcp:101:lsof.0 00010000:00010000:2.0:1790100470.843446:0:9338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100470.843491:0:9338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287bfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4e0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100470.843568:0:9338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287c04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100470.843584:0:9338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100470.843608:0:9338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100470.843692:0:9338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790100470.843696:0:9338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100470.843738:0:9338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100470.843766:0:9338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927000/0xc87a4f2298287bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4e0 expref: 7 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100470.843787:0:9338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287c04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4e0 expref: 6 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100470.843796:0:9338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:2.0:1790100470.843799:0:9338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100470.843802:0:9338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927e00, rc 0) 00000100:00100000:2.0:1790100470.843876:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:13164:x1877056127347840:12345-192.168.203.13@tcp:101:lsof.0 Request processed in 454us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.843884:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 255 00000100:00100000:1.0:1790100471.240679:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100471.240704:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141008128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100471.240783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100471.241463:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100471.241476:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141008256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790100471.241513:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100471.241743:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141008128 00000100:00100000:2.0:1790100471.241751:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141008128 00000100:00080000:0.0:1790100471.241880:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100471.241906:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141008256 00000100:00100000:0.0:1790100471.241910:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141008256 00000100:00100000:0.0:1790100471.241957:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790100471.241966:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141008256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100471.241995:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790100471.242046:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141008256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100471.242053:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1790100471.242255:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100471.242327:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141008256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100471.242440:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790100471.242449:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141008128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100471.242462:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790100471.242503:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141008128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100471.242509:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790100471.242588:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141008128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790100471.624815:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100472.203964:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790100472.264722:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141008384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100472.264782:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100472.264973:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141008384 00000100:00100000:2.0:1790100472.264981:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141008384 00000100:00100000:2.0:1790100472.265030:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790100472.265039:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141008384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100472.265071:0:7542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1790100472.265201:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141008384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100472.265209:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790100472.265781:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141008384:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790100472.648507:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100472.776908:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100472.776931:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141008512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100472.776996:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100472.777308:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141008512 00000100:00100000:2.0:1790100472.777316:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141008512 00000100:00100000:2.0:1790100472.777402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790100472.777412:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141008512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100472.777443:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100472.777500:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141008512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100472.777507:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790100472.777702:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141008512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100472.837130:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100472.837218:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127348096 00000100:00100000:1.0:1790100472.837228:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127348096 00000100:00100000:1.0:1790100472.837300:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1790100472.837311:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+18:13165:x1877056127348096:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:1.0:1790100472.837615:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+19:13165:x1877056127348096:12345-192.168.203.13@tcp:35:umount.0 Request processed in 304us (493us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790100472.837624:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00080000:0.0:1790100472.839332:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100472.846458:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100472.846596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127348352 00000100:00100000:1.0:1790100472.846606:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127348352 00000100:00100000:1.0:1790100472.846665:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1790100472.846676:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+19:13165:x1877056127348352:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:1.0:1790100472.846989:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+20:13165:x1877056127348352:12345-192.168.203.13@tcp:35:umount.0 Request processed in 315us (539us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1790100472.847010:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1790100472.849915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100472.850230:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127348608 00000100:00100000:1.0:1790100472.850240:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127348608 00000100:00100000:1.0:1790100472.850295:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1790100472.850305:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b21d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+20:13165:x1877056127348608:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:1.0:1790100472.850696:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b21d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e84eb833-b466-4273-a7db-c12bb35adfb4+21:13165:x1877056127348608:12345-192.168.203.13@tcp:35:umount.0 Request processed in 391us (799us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1790100472.850704:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1790100472.862597:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100472.862687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127348864 00000100:00100000:2.0:1790100472.862697:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127348864 00000100:00100000:2.0:1790100472.862744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1790100472.862754:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+21:13165:x1877056127348864:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:2.0:1790100472.863308:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+22:13165:x1877056127348864:12345-192.168.203.13@tcp:35:umount.0 Request processed in 553us (719us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1790100472.863317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1790100472.870103:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100472.870152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100472.870182:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100472.870213:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100472.870244:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127348992 00000100:00100000:3.0:1790100472.870254:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127348992 00000100:00100000:3.0:1790100472.870298:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127349376 00000100:00100000:3.0:1790100472.870301:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127349376 00000100:00100000:3.0:1790100472.870313:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127349120 00000100:00100000:3.0:1790100472.870315:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127349120 00000100:00100000:3.0:1790100472.870329:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1790100472.870369:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+15:2419:x1877056127348992:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100472.870385:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100472.870404:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565de00/0xc87a4f2298286b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e03a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100472.870419:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100472.870467:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+14:2419:x1877056127348992:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 129us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100472.870473:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1790100472.870490:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1790100472.870496:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+13:2421:x1877056127349376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100472.870518:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100472.870527:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59000/0xc87a4f2298286dfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e113 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100472.870536:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100472.870566:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:2421:x1877056127349376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 70us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100472.870572:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1790100472.870585:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1790100472.870591:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:2419:x1877056127349120:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100472.870599:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100472.870607:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926180030a00/0xc87a4f2298286a76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230dffb expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100472.870615:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100472.870630:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2419:x1877056127349120:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100472.870636:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1790100472.871262:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127349248 00000100:00100000:2.0:1790100472.871269:0:10090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127349248 00000100:00100000:2.0:1790100472.871323:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:2.0:1790100472.871357:0:10090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b7be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2418:x1877056127349248:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:2.0:1790100472.871380:0:10090:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286f07 00000100:00080000:2.0:1790100472.871388:0:10090:0:(import.c:65:import_set_state_nolock()) ffff926185557800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790100472.871424:0:10090:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1790100472.871645:0:10090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b7be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e84eb833-b466-4273-a7db-c12bb35adfb4+2:2418:x1877056127349248:12345-192.168.203.13@tcp:9:umount.0 Request processed in 208us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100472.871653:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00010000:00010000:0.0:1790100472.871907:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100472.871915:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100472.881711:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100472.881915:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127349760 00000100:00100000:2.0:1790100472.882013:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127349760 00000100:00100000:2.0:1790100472.882090:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:2.0:1790100472.882100:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+7:2418:x1877056127349760:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:2.0:1790100472.882130:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298287176 00000020:00010000:2.0:1790100472.882138:0:8427:0:(genops.c:1920:obd_stale_export_put()) Put export ffff926184c3d800: total 0 00000100:00080000:2.0:1790100472.882142:0:8427:0:(import.c:65:import_set_state_nolock()) ffff926184c3b000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1790100472.882228:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1790100472.882287:0:8427:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790100472.882497:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2418:x1877056127349760:12345-192.168.203.13@tcp:9:umount.0 Request processed in 398us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100472.882505:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000020:00010000:1.0:1790100472.893877:0:6502:0:(genops.c:1906:obd_stale_export_get()) Get export ffff926184c3d800: total 0 00010000:00010000:1.0:1790100472.894118:0:6502:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff926184c3d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1790100472.894177:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298287bf6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4d9 expref: 4 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.894216:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a83f8c9f/0xc87a4f2298287535 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2fd expref: 3 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.894231:0:6502:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff926184c3d800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790100472.894243:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100472.894246:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100472.894247:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100472.923333:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100472.924067:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127350784 00000100:00100000:2.0:1790100472.924078:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127350784 00000100:00100000:2.0:1790100472.924132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 256 00000100:00100000:2.0:1790100472.924142:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+22:2418:x1877056127350784:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:2.0:1790100472.924177:0:6513:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a84 00000020:00010000:2.0:1790100472.924195:0:6513:0:(genops.c:1920:obd_stale_export_put()) Put export ffff926083b43800: total 0 00000100:00080000:2.0:1790100472.924200:0:6513:0:(import.c:65:import_set_state_nolock()) ffff926083b41000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790100472.924228:0:6513:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1790100472.924408:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e84eb833-b466-4273-a7db-c12bb35adfb4+21:2418:x1877056127350784:12345-192.168.203.13@tcp:39:umount.0 Request processed in 266us (1084us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1790100472.924429:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 256 00000020:00010000:1.0:1790100472.924522:0:7461:0:(genops.c:1906:obd_stale_export_get()) Get export ffff926083b43800: total 0 00010000:00010000:1.0:1790100472.924585:0:7461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff926083b43800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790100472.924619:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100472.924623:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100472.924631:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927800/0xc87a4f2298287ad7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e48c expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.924661:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100472.924664:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790100472.924669:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927a00/0xc87a4f2298286edd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e13d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.924681:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff926083e1b100) 00010000:00010000:1.0:1790100472.924684:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100472.924687:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298286e66 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e121 expref: 18 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.924706:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100472.924708:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790100472.924712:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f600/0xc87a4f22982875ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e319 expref: 17 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.924725:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100472.924727:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100472.924731:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926c00/0xc87a4f22982874f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2e8 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.924743:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff926183194d00) 00010000:00010000:1.0:1790100472.924744:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100472.924748:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f2298287899 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e3f2 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.924762:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff926083b64f00) 00010000:00010000:1.0:1790100472.924764:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100472.924774:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f000/0xc87a4f22982871d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e216 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.925128:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100472.925132:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100472.925137:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298287bb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4c4 expref: 13 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.925151:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff926083e1bc00) 00010000:00010000:1.0:1790100472.925153:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100472.925157:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f2298286e82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e128 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.925171:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff926183194f00) 00010000:00010000:1.0:1790100472.925174:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790100472.925178:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e200/0xc87a4f2298287be1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4d2 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.925195:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100472.925197:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790100472.925201:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47600/0xc87a4f2298287520 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2f6 expref: 10 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.925213:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff926183194000) 00010000:00010000:1.0:1790100472.925215:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100472.925218:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ec00/0xc87a4f2298287416 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e2b0 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.925234:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:1.0:1790100472.925242:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100472.925247:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083926e00/0xc87a4f2298287590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e312 expref: 8 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100472.925260:0:7461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff926083b43800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790100472.925276:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100472.925277:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100472.925279:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100472.938100:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100472.938727:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127350912 00000100:00100000:3.0:1790100472.938739:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127350912 00000100:00100000:3.0:1790100472.938820:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 257 00000100:00100000:3.0:1790100472.938831:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+5:2418:x1877056127350912:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:3.0:1790100472.938871:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a8b 00000100:00080000:3.0:1790100472.938887:0:6514:0:(import.c:65:import_set_state_nolock()) ffff926083266000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790100472.938937:0:6514:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790100472.939090:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e84eb833-b466-4273-a7db-c12bb35adfb4+3:2418:x1877056127350912:12345-192.168.203.13@tcp:39:umount.0 Request processed in 261us (999us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790100472.939098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 257 00010000:00010000:1.0:1790100472.939262:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100472.940150:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100473.288603:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141008768:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.288661:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100473.288712:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141009280:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.288745:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100473.288764:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141009792:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.288781:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100473.288800:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790100473.288805:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141008896:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.288825:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100473.288837:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141009408:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.288869:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100473.288884:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141009920:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.288903:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100473.288926:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141008768 00000100:00100000:0.0:1790100473.288933:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141008768 00000100:00100000:0.0:1790100473.288971:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141009280 00000100:00100000:0.0:1790100473.288974:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141009280 00000100:00100000:0.0:1790100473.288997:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141009792 00000100:00100000:0.0:1790100473.289000:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141009792 00000100:00100000:0.0:1790100473.289015:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790100473.289023:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141008768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.289073:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141008768:12345-0@lo:400:kworker.0 Request processed in 50us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100473.289081:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790100473.289099:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1790100473.289104:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141009280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.289130:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141009280:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100473.289135:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1790100473.289155:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1790100473.289161:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056141009792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.289186:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1877056141009792:12345-0@lo:400:kworker.0 Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100473.289191:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:0.0:1790100473.289209:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100473.289233:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141008768:0@lo:400:kworker.0 00010000:00080000:0.0:1790100473.289244:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92608497c380 x1877056141009280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100473.289254:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141009280:0@lo:400:kworker.0 00010000:00080000:0.0:1790100473.289262:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92608497ea00 x1877056141009792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100473.289270:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141009792:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289389:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141008896 00000100:00100000:2.0:1790100473.289393:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141008896 00000100:00100000:2.0:1790100473.289418:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790100473.289424:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141008896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289460:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141008896:12345-0@lo:400:kworker.0 Request processed in 37us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.289467:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790100473.289489:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141009024:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289511:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100473.289526:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141009536:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100473.289556:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141010048:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100473.289584:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790100473.289589:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141008640:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289612:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100473.289631:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141009152:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100473.289657:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141009664:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289672:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100473.289690:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141008640 00000100:00100000:2.0:1790100473.289693:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141008640 00000100:00100000:2.0:1790100473.289716:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1790100473.289722:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141008640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289762:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141008640:12345-0@lo:400:kworker.0 Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.289769:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1790100473.289793:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141009024 00000100:00100000:2.0:1790100473.289795:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141009024 00000100:00100000:2.0:1790100473.289807:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141009152 00000100:00100000:2.0:1790100473.289809:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141009152 00000100:00100000:2.0:1790100473.289821:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141009664 00000100:00100000:2.0:1790100473.289823:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141009664 00000100:00100000:2.0:1790100473.289832:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1790100473.289837:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141009024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289876:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141009024:12345-0@lo:400:kworker.0 Request processed in 37us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.289882:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1790100473.289892:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1790100473.289897:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141009152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289918:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141009152:12345-0@lo:400:kworker.0 Request processed in 21us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.289923:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1790100473.289932:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790100473.289937:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056141009664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.289960:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056141009664:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.289966:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790100473.289984:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141009408 00000100:00100000:2.0:1790100473.289987:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141009408 00000100:00100000:2.0:1790100473.290005:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141009920 00000100:00100000:2.0:1790100473.290013:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141009920 00000100:00100000:2.0:1790100473.290027:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141009536 00000100:00100000:2.0:1790100473.290029:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141009536 00000100:00100000:2.0:1790100473.290038:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141010048 00000100:00100000:2.0:1790100473.290040:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141010048 00000100:00100000:2.0:1790100473.290052:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790100473.290057:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141009408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290086:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141009408:12345-0@lo:400:kworker.0 Request processed in 28us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.290091:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790100473.290101:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790100473.290107:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141009920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290130:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141009920:12345-0@lo:400:kworker.0 Request processed in 24us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.290136:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790100473.290145:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790100473.290151:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141009536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290172:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141009536:12345-0@lo:400:kworker.0 Request processed in 22us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.290177:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790100473.290186:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790100473.290190:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141010048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290209:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141010048:12345-0@lo:400:kworker.0 Request processed in 20us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100473.290214:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790100473.290235:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141008640:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290253:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141009152:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290260:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141009664:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290267:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141009024:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290274:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141009536:0@lo:400:kworker.0 00000100:00100000:2.0:1790100473.290282:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141010048:0@lo:400:kworker.0 00000040:00080000:3.0:1790100473.290910:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100473.290915:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100473.291015:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1790100473.291022:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790100473.292060:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141010176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100473.292112:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790100473.292598:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100473.292603:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100473.292606:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100473.292617:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141010304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100473.292644:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100473.292680:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141008896:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.292692:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141009408:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.292701:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141009920:0@lo:400:kworker.0 00000100:00100000:0.0:1790100473.292733:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141010176 00000100:00100000:0.0:1790100473.292739:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141010176 00000100:00100000:0.0:1790100473.292774:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141010304 00000100:00100000:0.0:1790100473.292789:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141010304 00000100:00100000:0.0:1790100473.292805:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790100473.292811:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141010176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100473.292836:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100473.292884:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141010176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100473.292890:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790100473.292905:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790100473.292910:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141010304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100473.292918:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100473.292942:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141010304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100473.292948:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790100473.292980:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141010176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100473.293003:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141010304:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1790100473.676117:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100474.697862:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100475.238550:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100475.238650:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100475.238691:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100475.238757:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127351040 00000100:00100000:1.0:1790100475.238776:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127351040 00000100:00100000:1.0:1790100475.238842:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 380 00000100:00100000:1.0:1790100475.238852:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2420:x1877056127351040:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100475.238919:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2420:x1877056127351040:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100475.238926:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 380 00000100:00100000:2.0:1790100475.255526:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127351168 00000100:00100000:2.0:1790100475.255542:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127351168 00000100:00100000:2.0:1790100475.257403:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127351296 00000100:00100000:2.0:1790100475.257416:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127351296 00000100:00100000:0.0:1790100475.257510:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 295 00000100:00100000:0.0:1790100475.257522:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2420:x1877056127351168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100475.257604:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2420:x1877056127351168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 83us (19063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100475.257612:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 295 00000100:00100000:0.0:1790100475.257633:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:0.0:1790100475.257640:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127351296:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790100475.257664:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2420:x1877056127351296:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (18973us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100475.257685:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00080000:3.0:1790100475.257775:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790100475.257781:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790100475.720504:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100476.361071:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100476.361095:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141010432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100476.361162:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100476.361511:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141010432 00000100:00100000:3.0:1790100476.361520:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141010432 00000100:00100000:3.0:1790100476.361579:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790100476.361589:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141010432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100476.361618:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790100476.361663:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141010432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100476.361669:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1790100476.362772:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100476.362899:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141010432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100476.370160:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100476.370184:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141010560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100476.370250:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100476.370378:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141010560 00000100:00100000:3.0:1790100476.370386:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141010560 00000100:00100000:3.0:1790100476.370462:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790100476.370472:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141010560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100476.370492:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790100476.370533:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141010560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100476.370554:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790100476.370713:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141010560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790100476.370892:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790100476.744473:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100477.385615:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141010688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100477.385681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100477.385936:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141010688 00000100:00100000:3.0:1790100477.385945:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141010688 00000100:00100000:3.0:1790100477.386103:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790100477.386113:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141010688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100477.386145:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790100477.386247:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141010688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100477.386254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790100477.386523:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141010688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100477.397061:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100477.397096:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100477.397127:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100477.397157:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127351424 00000100:00100000:0.0:1790100477.397165:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127351424 00000100:00100000:0.0:1790100477.397206:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127351680 00000100:00100000:0.0:1790100477.397208:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127351680 00000100:00100000:0.0:1790100477.397216:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127351552 00000100:00100000:0.0:1790100477.397218:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127351552 00000100:00100000:0.0:1790100477.397229:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1790100477.397236:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+12:2422:x1877056127351424:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100477.397248:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100477.397264:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926000/0xc87a4f2298286c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e04f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100477.397280:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100477.397318:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+11:2422:x1877056127351424:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100477.397324:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1790100477.397337:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1790100477.397371:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+10:2422:x1877056127351680:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100477.397377:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100477.397385:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58000/0xc87a4f2298286df6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e10c expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100477.397416:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100477.397432:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+9:2422:x1877056127351680:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 62us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100477.397438:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1790100477.397448:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1790100477.397453:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184253850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+8:2422:x1877056127351552:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100477.397458:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100477.397465:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926400/0xc87a4f2298286c44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e080 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100477.397472:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100477.397484:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184253850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+7:2422:x1877056127351552:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100477.397488:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1790100477.408702:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100477.408774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127351936 00000100:00100000:0.0:1790100477.408781:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127351936 00000100:00100000:0.0:1790100477.408846:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 258 00000100:00100000:0.0:1790100477.408854:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+6:2418:x1877056127351936:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:0.0:1790100477.408885:0:6512:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286c52 00000020:00010000:0.0:1790100477.408891:0:6512:0:(genops.c:1920:obd_stale_export_put()) Put export ffff926083d7d000: total 0 00000100:00080000:0.0:1790100477.408896:0:6512:0:(import.c:65:import_set_state_nolock()) ffff926083d7c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790100477.409028:0:6512:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1790100477.409159:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2418:x1877056127351936:12345-192.168.203.13@tcp:39:umount.0 Request processed in 306us (464us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1790100477.409165:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 258 00000100:00080000:2.0:1790100477.409884:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1790100477.410189:0:7461:0:(genops.c:1906:obd_stale_export_get()) Get export ffff926083d7d000: total 0 00010000:00010000:3.0:1790100477.410194:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100477.410595:0:7461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff926083d7d000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790100477.410633:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff926183194c00) 00010000:00010000:3.0:1790100477.410637:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100477.410646:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083927e00/0xc87a4f2298287c04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4e0 expref: 4 pid: 9338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100477.410668:0:7461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff926083d7d000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790100477.410683:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100477.410685:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100477.410687:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100477.417082:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100477.417176:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127352064 00000100:00100000:0.0:1790100477.417184:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127352064 00000100:00100000:0.0:1790100477.417251:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 259 00000100:00100000:0.0:1790100477.417260:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+5:2418:x1877056127352064:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:0.0:1790100477.417295:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286c59 00000100:00080000:0.0:1790100477.417303:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9260821ba000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790100477.417327:0:6514:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790100477.417494:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd276aa8-34fd-43b4-a3ff-22c247b7b6ea+3:2418:x1877056127352064:12345-192.168.203.13@tcp:39:umount.0 Request processed in 235us (420us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790100477.417501:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 259 00010000:00010000:1.0:1790100477.417583:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790100477.417648:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100477.486769:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100477.486868:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127352320 00000100:00100000:2.0:1790100477.486878:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127352320 00000100:00100000:2.0:1790100477.486941:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 381 00000100:00100000:2.0:1790100477.486951:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+7:2418:x1877056127352320:12345-192.168.203.13@tcp:251:umount.0 00000020:00000080:2.0:1790100477.486992:0:6507:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a61 00000020:00010000:2.0:1790100477.487012:0:6507:0:(genops.c:1920:obd_stale_export_put()) Put export ffff926083167800: total 0 00000100:00080000:2.0:1790100477.487017:0:6507:0:(import.c:65:import_set_state_nolock()) ffff926083164800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790100477.487089:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93b87c-aa02-4433-9e3b-35d1ec3ad5ae+3:2418:x1877056127352320:12345-192.168.203.13@tcp:251:umount.0 Request processed in 140us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100477.487097:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 381 00000020:00010000:3.0:1790100477.487645:0:6502:0:(genops.c:1906:obd_stale_export_get()) Get export ffff926083167800: total 0 00010000:00010000:3.0:1790100477.487704:0:6502:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff926083167800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790100477.487735:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58a00/0xc87a4f2298286b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e041 expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100477.487771:0:6502:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff926083167800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1790100477.487785:0:6502:0:(genops.c:885:class_export_put()) final put ffff926083167800/de93b87c-aa02-4433-9e3b-35d1ec3ad5ae 00010000:00010000:3.0:1790100477.487800:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100477.487802:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100477.487804:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790100477.487841:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926083167800/de93b87c-aa02-4433-9e3b-35d1ec3ad5ae for MGS 00000020:00000080:2.0:1790100477.487877:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083164800 for MGS 00010000:00010000:2.0:1790100477.774581:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100477.900255:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141010816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100477.900323:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100477.900534:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141010816 00000100:00100000:2.0:1790100477.900543:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141010816 00000100:00100000:2.0:1790100477.900590:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790100477.900600:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141010816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100477.900633:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790100477.900866:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141010816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 267us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100477.900874:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790100477.900948:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141010816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100478.411582:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141011072:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.411646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.411706:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141011584:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.411732:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.411751:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141012096:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.411771:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.411792:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790100478.411797:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141011200:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.411826:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.411841:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056141011712:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.411857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.411870:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056141012224:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.411886:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.411916:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141011072 00000100:00100000:0.0:1790100478.411924:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141011072 00000100:00100000:0.0:1790100478.411985:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1790100478.411994:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141011072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412041:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141011072:12345-0@lo:400:kworker.0 Request processed in 49us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.412048:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1790100478.412080:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141011584 00000100:00100000:0.0:1790100478.412083:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141011584 00000100:00100000:0.0:1790100478.412110:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141012096 00000100:00100000:0.0:1790100478.412113:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141012096 00000100:00100000:0.0:1790100478.412126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141011200 00000100:00100000:0.0:1790100478.412128:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141011200 00000100:00100000:0.0:1790100478.412157:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141011712 00000100:00100000:0.0:1790100478.412160:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141011712 00000100:00100000:0.0:1790100478.412173:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141012224 00000100:00100000:0.0:1790100478.412176:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141012224 00000100:00100000:0.0:1790100478.412190:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1790100478.412196:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141011584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412228:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141011584:12345-0@lo:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.412234:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1790100478.412248:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790100478.412254:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056141012096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412279:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056141012096:12345-0@lo:400:kworker.0 Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.412284:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790100478.412296:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790100478.412302:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141011200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412326:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141011200:12345-0@lo:400:kworker.0 Request processed in 25us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.412357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790100478.412372:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790100478.412378:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056141011712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412406:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056141011712:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.412411:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790100478.412422:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790100478.412428:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056141012224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412452:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056141012224:12345-0@lo:400:kworker.0 Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.412457:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790100478.412498:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141011200:0@lo:400:kworker.0 00010000:00080000:0.0:1790100478.412510:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b79ed880 x1877056141011712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100478.412520:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056141011712:0@lo:400:kworker.0 00010000:00080000:0.0:1790100478.412530:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92608497c000 x1877056141012224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100478.412537:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056141012224:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412545:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141011072:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412553:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141011584:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412561:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141012096:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412609:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141011328:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412643:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.412663:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141011840:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412685:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.412701:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141012352:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412717:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.412732:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1790100478.412737:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141010944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100478.412756:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.412770:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056141011456:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.412799:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141011968:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412830:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.412846:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141012480:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.412865:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100478.412893:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141010944 00000100:00100000:0.0:1790100478.412897:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141010944 00000100:00100000:0.0:1790100478.412925:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790100478.412931:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141010944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100478.412951:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790100478.412982:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141010944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.412987:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790100478.413014:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141010944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100478.413030:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141011456 00000100:00100000:0.0:1790100478.413033:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141011456 00000100:00100000:0.0:1790100478.413062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790100478.413067:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056141011456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413099:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056141011456:12345-0@lo:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.413104:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790100478.413128:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056141011456:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413152:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141011840 00000100:00100000:0.0:1790100478.413155:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141011840 00000100:00100000:0.0:1790100478.413172:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141012352 00000100:00100000:0.0:1790100478.413174:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141012352 00000100:00100000:0.0:1790100478.413182:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141011968 00000100:00100000:0.0:1790100478.413184:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141011968 00000100:00100000:0.0:1790100478.413193:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141012480 00000100:00100000:0.0:1790100478.413195:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141012480 00000100:00100000:0.0:1790100478.413206:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790100478.413211:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141011840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413242:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141011840:12345-0@lo:400:kworker.0 Request processed in 31us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.413248:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790100478.413259:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790100478.413264:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141012352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413287:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141012352:12345-0@lo:400:kworker.0 Request processed in 24us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.413293:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790100478.413303:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790100478.413308:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141011968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413331:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141011968:12345-0@lo:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.413364:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790100478.413376:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790100478.413382:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141012480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413411:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141012480:12345-0@lo:400:kworker.0 Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100478.413417:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790100478.413443:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141011968:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413452:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141012480:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413460:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141011840:0@lo:400:kworker.0 00000100:00100000:0.0:1790100478.413466:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141012352:0@lo:400:kworker.0 00000100:00080000:2.0:1790100478.418003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100478.418013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100478.418017:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100478.418019:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100478.427185:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141011328 00000100:00100000:3.0:1790100478.427194:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141011328 00000100:00100000:3.0:1790100478.427237:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790100478.427245:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141011328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100478.427332:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141011328:12345-0@lo:400:kworker.0 Request processed in 87us (14687us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100478.427359:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790100478.427410:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100478.427423:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141012608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100478.427458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100478.427493:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141012608 00000100:00100000:3.0:1790100478.427496:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141012608 00000100:00100000:3.0:1790100478.427521:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790100478.427528:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141012608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100478.427543:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790100478.427575:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141012608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100478.427581:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790100478.427616:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141012608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100478.427660:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141011328:0@lo:400:kworker.0 00000001:00100000:0.0:1790100478.429695:0:7441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000001:00080000:0.0:1790100478.429709:0:7441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1790100478.429714:0:7441:0:(genops.c:885:class_export_put()) final put ffff9260821bf000/fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000001:00100000:0.0:1790100478.429727:0:7441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000001:00080000:0.0:1790100478.429733:0:7441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1790100478.429735:0:7441:0:(genops.c:885:class_export_put()) final put ffff926083264800/e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:0.0:1790100478.429758:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9260821bf000/fd276aa8-34fd-43b4-a3ff-22c247b7b6ea for lustre-MDT0001 00000020:00000080:0.0:1790100478.429820:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926083264800/e84eb833-b466-4273-a7db-c12bb35adfb4 for lustre-MDT0001 00000020:00000080:0.0:1790100478.429845:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9260821ba000 for lustre-MDT0001 00000020:00000080:0.0:1790100478.429850:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083266000 for lustre-MDT0001 00010000:00010000:0.0:1790100478.792839:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790100478.930865:0:6492:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000001:00080000:2.0:1790100478.930880:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1790100478.930886:0:6492:0:(genops.c:885:class_export_put()) final put ffff926083d7d000/fd276aa8-34fd-43b4-a3ff-22c247b7b6ea 00000001:00100000:2.0:1790100478.930904:0:6492:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000001:00080000:2.0:1790100478.930909:0:6492:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1790100478.930917:0:6492:0:(genops.c:885:class_export_put()) final put ffff926083b43800/e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:0.0:1790100478.931029:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926083d7d000/fd276aa8-34fd-43b4-a3ff-22c247b7b6ea for lustre-MDT0000 00000020:00000080:0.0:1790100478.931081:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926083b43800/e84eb833-b466-4273-a7db-c12bb35adfb4 for lustre-MDT0000 00000020:00000080:0.0:1790100478.931112:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083d7c000 for lustre-MDT0000 00000020:00000080:0.0:1790100478.931128:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083b41000 for lustre-MDT0000 00000001:00100000:3.0:1790100478.931206:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:3.0:1790100478.931211:0:8420:0:(genops.c:885:class_export_put()) final put ffff926184c3d800/e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:0.0:1790100478.931259:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926184c3d800/e84eb833-b466-4273-a7db-c12bb35adfb4 for lustre-OST0000 00000020:00000080:0.0:1790100478.931276:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926184c3b000 for lustre-OST0000 00000001:00100000:2.0:1790100478.931330:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:2.0:1790100478.931334:0:9503:0:(genops.c:885:class_export_put()) final put ffff926185556800/e84eb833-b466-4273-a7db-c12bb35adfb4 00000020:00000080:0.0:1790100478.931449:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926185556800/e84eb833-b466-4273-a7db-c12bb35adfb4 for lustre-OST0001 00000020:00000080:0.0:1790100478.931469:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926185557800 for lustre-OST0001 00010000:00010000:3.0:1790100479.817974:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790100480.022309:0:15188:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790100480.096504:0:15188:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790100480.096561:0:15188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.096576:0:15188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.096583:0:15188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.096588:0:15188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.096608:0:15188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790100480.096613:0:15188:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790100480.096643:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790100480.096648:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790100480.096654:0:15188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790100480.096691:0:15188:0:(import.c:65:import_set_state_nolock()) ffff9261c1989800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790100480.096938:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056141012736:0@lo:39:umount.0 00000100:00100000:0.0:1790100480.097001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100480.097257:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141012736 00000100:00100000:1.0:1790100480.097264:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141012736 00000100:00100000:1.0:1790100480.097313:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790100480.097321:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877056141012736:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790100480.097363:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f229828673c 00000100:00080000:1.0:1790100480.097382:0:6514:0:(import.c:65:import_set_state_nolock()) ffff926187c4d000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790100480.097448:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1877056141012736:12345-0@lo:39:umount.0 Request processed in 127us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100480.097455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000020:00000080:1.0:1790100480.097464:0:6514:0:(genops.c:885:class_export_put()) final put ffff926187c4c800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1790100480.097520:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100480.097527:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.097536:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58800 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100480.097540:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.097549:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100480.097557:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100480.097563:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790100480.097566:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790100480.097568:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790100480.097592:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.097598:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100480.097626:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.097633:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e58800/0xc87a4f2298286c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286c0c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.097644:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100480.097652:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100480.097653:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100480.097660:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100480.097671:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141012864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100480.097717:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100480.097748:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141012864 00000100:00100000:3.0:1790100480.097753:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141012864 00000100:00100000:3.0:1790100480.097784:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790100480.097803:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+24:3641:x1877056141012864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100480.097814:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100480.097827:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58400/0xc87a4f2298286c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286c05 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.097838:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100480.097865:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a237a43-d248-40fc-b145-fd7f23146511+23:3641:x1877056141012864:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100480.097871:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790100480.097904:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141012864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100480.098035:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790100480.098947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff926187c4c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790100480.098991:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926187c4d000 for lustre-MDT0000 00000100:00080000:0.0:1790100480.099116:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261c1989800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790100480.099134:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056141012736:0@lo:39:umount.0 00000100:00080000:1.0:1790100480.099195:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790100480.099198:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790100480.099203:0:15188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790100480.100091:0:15188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100103:0:15188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100111:0:15188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100118:0:15188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100138:0:15188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100480.100144:0:15188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100149:0:15188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100155:0:15188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100161:0:15188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100184:0:15188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790100480.100191:0:15188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100197:0:15188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100204:0:15188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100210:0:15188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100220:0:15188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1790100480.100225:0:15188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100231:0:15188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100236:0:15188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100242:0:15188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100480.100248:0:15188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1790100480.100251:0:15188:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1790100480.100285:0:15188:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1790100480.100289:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1790100480.100293:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100480.100299:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1790100480.100303:0:15188:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9261a631d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790100480.100309:0:15188:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff926082852800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790100480.100313:0:15188:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9261b69b4800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790100480.100317:0:15188:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9261b69b5800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1790100480.100322:0:15188:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff92618684b380) has exports, disconnecting them 00000020:00080000:1.0:1790100480.100326:0:15188:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9261a631d800), last request at 1790100478 00000020:00000080:1.0:1790100480.100332:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a3e 00000100:00080000:1.0:1790100480.100372:0:15188:0:(import.c:65:import_set_state_nolock()) ffff9261a631f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790100480.100415:0:15188:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9261a631d800): rc 0 00000020:00000080:1.0:1790100480.100418:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261a631d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1790100480.100427:0:15188:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff926082852800), last request at 1790100478 00000020:00000080:1.0:1790100480.100429:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286918 00000100:00080000:1.0:1790100480.100435:0:15188:0:(import.c:65:import_set_state_nolock()) ffff926082855800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790100480.100441:0:15188:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff926082852800): rc 0 00000020:00000080:1.0:1790100480.100442:0:15188:0:(genops.c:885:class_export_put()) final put ffff926082852800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1790100480.100446:0:15188:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9261b69b4800), last request at 1790100297 00000020:00000080:1.0:1790100480.100449:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286815 00000100:00080000:1.0:1790100480.100452:0:15188:0:(import.c:65:import_set_state_nolock()) ffff9261b69b0000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790100480.100457:0:15188:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9261b69b4800): rc 0 00000020:00000080:1.0:1790100480.100459:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261b69b4800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1790100480.100462:0:15188:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9261b69b5800), last request at 1790100297 00000020:00000080:1.0:1790100480.100465:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982867d6 00000100:00080000:1.0:1790100480.100468:0:15188:0:(import.c:65:import_set_state_nolock()) ffff9261b69b2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100480.100474:0:15188:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1790100480.100563:0:15188:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9261b69b5800): rc 0 00000004:00000080:1.0:1790100480.100570:0:15188:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbae48188fae0 00000100:00080000:1.0:1790100480.100587:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790100480.100591:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1790100480.101440:0:15188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790100480.101461:0:15188:0:(import.c:65:import_set_state_nolock()) ffff9261b203f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790100480.101587:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790100480.101590:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1790100480.101600:0:15188:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790100480.101653:0:15188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790100480.101664:0:15188:0:(import.c:65:import_set_state_nolock()) ffff9261a62fd800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790100480.101671:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790100480.101673:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1790100480.101680:0:15188:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790100480.101736:0:15188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790100480.101745:0:15188:0:(import.c:65:import_set_state_nolock()) ffff9261b777a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790100480.101804:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff92618684b380) has no exports 00010000:00010000:2.0:1790100480.101955:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790100480.101963:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.101972:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100480.101976:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.101985:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100480.101992:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100480.101998:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100480.102000:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1790100480.102003:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1790100480.102028:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102046:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100480.102073:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102080:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083e47400/0xc87a4f2298286c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286c1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102093:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790100480.102097:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102112:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261c2179000 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100480.102116:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102123:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100480.102130:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100480.102135:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100480.102137:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1790100480.102139:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1790100480.102153:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102159:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100480.102166:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102172:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261c2179000/0xc87a4f2298286b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286b25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102182:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100480.102186:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102191:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100480.102194:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102205:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100480.102211:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100480.102216:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790100480.102218:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790100480.102220:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790100480.102234:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102240:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100480.102256:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102263:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f2298286e2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286e35 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102273:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100480.102276:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102282:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c800 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100480.102285:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102291:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100480.102308:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100480.102313:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100480.102316:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790100480.102317:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790100480.102331:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102361:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100480.102368:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102374:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565c800/0xc87a4f229828668d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286694 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.102385:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100480.102387:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100480.102388:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100480.102395:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100480.102415:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056141013504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100480.102473:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100480.102517:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100480.102523:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056141013376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100480.102544:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100480.102568:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056141013760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100480.102591:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100480.102607:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100480.102619:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056141013632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100480.102644:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100480.102671:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141013504 00000100:00100000:3.0:1790100480.103910:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141013376 00000100:00100000:3.0:1790100480.103919:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141013376 00000100:00100000:3.0:1790100480.103958:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141013760 00000100:00100000:3.0:1790100480.103962:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141013760 00000100:00100000:3.0:1790100480.103975:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141013632 00000100:00100000:3.0:1790100480.103977:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141013632 00000100:00100000:3.0:1790100480.103993:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100480.104001:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+25:3644:x1877056141013376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100480.104014:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100480.104030:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083e46600/0xc87a4f2298286c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286c13 expref: 25 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.104051:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100480.104098:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+24:3644:x1877056141013376:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100480.104105:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100480.104122:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100480.104128:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+23:3642:x1877056141013760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100480.104136:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100480.104144:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58e00/0xc87a4f2298286694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f229828668d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.104153:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100480.104179:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+22:3642:x1877056141013760:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100480.104185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100480.104198:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100480.104204:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+21:3642:x1877056141013632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100480.104211:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100480.104218:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298286e35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286e2e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.104225:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100480.104246:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a237a43-d248-40fc-b145-fd7f23146511+20:3642:x1877056141013632:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100480.104252:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00000080:3.0:1790100480.104276:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a631d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790100480.104314:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff926082852800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790100480.104371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b4800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790100480.104409:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261a631f000 for lustre-MDT0000 00000020:00000080:3.0:1790100480.104413:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926082855800 for lustre-MDT0000 00000020:00000080:3.0:1790100480.104417:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261b69b0000 for lustre-MDT0000 00000100:00100000:3.0:1790100480.104455:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056141013376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100480.104495:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056141013632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100480.104502:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056141013760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100480.104587:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100480.104600:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141012992:0@lo:39:umount.0 00000100:00100000:0.0:1790100480.104635:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100480.104668:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141013120:0@lo:9:umount.0 00000100:00100000:0.0:1790100480.104703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100480.104722:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141013248:0@lo:9:umount.0 00000100:00100000:0.0:1790100480.104743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100480.104772:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141013120 00000100:00100000:0.0:1790100480.104776:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141013120 00000100:00100000:0.0:1790100480.104823:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141013248 00000100:00100000:0.0:1790100480.104827:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141013248 00000100:00100000:0.0:1790100480.104845:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790100480.104852:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877056141013120:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790100480.104872:0:8425:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982869c0 00000100:00080000:0.0:1790100480.104879:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9261a62f8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790100480.104917:0:8425:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1790100480.105053:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3640:x1877056141013120:12345-0@lo:9:umount.0 Request processed in 201us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100480.105067:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790100480.105082:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790100480.105087:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877056141013248:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790100480.105099:0:8425:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286b4f 00000100:00080000:0.0:1790100480.105104:0:8425:0:(import.c:65:import_set_state_nolock()) ffff926083b42800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790100480.105125:0:8425:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1790100480.105197:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3640:x1877056141013248:12345-0@lo:9:umount.0 Request processed in 109us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100480.105203:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1790100480.105229:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a62fd800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790100480.105240:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790100480.105242:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790100480.105245:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141013120:0@lo:9:umount.0 00000100:00080000:0.0:1790100480.105255:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b777a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790100480.105260:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790100480.105262:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790100480.105264:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141013248:0@lo:9:umount.0 00000100:00080000:0.0:1790100480.105300:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100480.105304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100480.105320:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100480.105326:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100480.105596:0:9513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141013504 00000100:00100000:2.0:1790100480.105631:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100480.105638:0:9513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a237a43-d248-40fc-b145-fd7f23146511+20:3644:x1877056141013504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100480.105646:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100480.105659:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189916800/0xc87a4f2298286b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286b1e expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100480.105671:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100480.105920:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141012992 00000100:00100000:3.0:1790100480.105925:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141012992 00000100:00100000:3.0:1790100480.105954:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790100480.105961:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877056141012992:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790100480.105978:0:7542:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286870 00000100:00080000:3.0:1790100480.105983:0:7542:0:(import.c:65:import_set_state_nolock()) ffff9261b69b7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790100480.106000:0:7542:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1790100480.106100:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1877056141012992:12345-0@lo:39:umount.0 Request processed in 139us (1464us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790100480.106107:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00010000:00010000:3.0:1790100480.106135:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100480.106165:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b203f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790100480.106171:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141012992:0@lo:39:umount.0 00000100:00100000:2.0:1790100480.106389:0:9513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a237a43-d248-40fc-b145-fd7f23146511+19:3644:x1877056141013504:12345-0@lo:103:ldlm_bl.0 Request processed in 749us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100480.106396:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100480.106532:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056141013504:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790100480.165374:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff92618684b380) has no exports 00000020:00000080:1.0:1790100480.279409:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982866e8 00000020:00000080:1.0:1790100480.279425:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261a24c1000/lustre-QMT0000_UUID 00000020:01000000:1.0:1790100480.279580:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790100480.279711:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790100480.279721:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790100480.279735:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9261b5ab0000) has no exports 00000020:00000080:0.0:1790100480.280272:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982866e1 00000020:00000080:0.0:1790100480.280279:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261c1927800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790100480.281961:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a24c1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790100480.285940:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790100480.285956:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790100480.285977:0:15188:0:(genops.c:885:class_export_put()) final put ffff92619036e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1790100480.285981:0:15188:0:(genops.c:844:class_export_destroy()) destroying export ffff92619036e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790100480.285992:0:15188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1790100480.286823:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261c1927800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1790100480.841021:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100481.482038:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100481.482058:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141013888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790100481.482130:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100481.482181:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141013888 00000100:00100000:3.0:1790100481.482188:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141013888 00000100:00100000:3.0:1790100481.482235:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790100481.482243:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141013888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100481.482267:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790100481.482316:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141013888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100481.482323:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790100481.482388:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141013888:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790100481.482740:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100481.864554:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100482.445508:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790100482.505260:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100482.505281:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141014016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100482.505368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100482.505614:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141014016 00000100:00100000:2.0:1790100482.505623:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141014016 00000100:00100000:2.0:1790100482.505679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790100482.505686:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1877056141014016:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1790100482.505695:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790100482.505749:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1877056141014016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (380us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790100482.505756:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:02020000:1.0:1790100482.505928:0:3643:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1790100482.516172:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790100482.516179:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9261b8ed4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790100482.516184:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790100482.538625:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9261b8ed4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100482.538645:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 148 00000100:00080000:1.0:1790100482.538781:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9261b8ed4800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100482.538856:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926084c11180 x1877056141014144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100482.543112:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141014144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1790100482.543186:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100482.557991:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141014144 00000100:00100000:1.0:1790100482.558006:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141014144 00000100:00100000:1.0:1790100482.558059:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790100482.558067:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877056141014144:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1790100482.558084:0:6518:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790100482.574472:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877056141014144:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 16397us (31277us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790100482.574485:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1790100482.574843:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b8ed4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100482.574850:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790100482.574854:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141014144:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1790100482.888991:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100483.528792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790100483.528799:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790100483.528803:0:37:0:(import.c:65:import_set_state_nolock()) ffff9261b8ed4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100483.528810:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 333 00000100:00080000:0.0:1790100483.528825:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790100483.528836:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9261b8ed4800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100483.528868:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6257100 x1877056141014400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100483.528987:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141014400:0@lo:38:kworker.0 00000100:00100000:0.0:1790100483.529076:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100483.529191:0:7542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141014400 00000100:00100000:0.0:1790100483.529198:0:7542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141014400 00000100:00100000:0.0:1790100483.529269:0:7542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790100483.529276:0:7542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1877056141014400:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1790100483.529302:0:7542:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790100483.531927:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141014272:0@lo:400:kworker.0 00000100:00100000:1.0:1790100483.532017:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100483.532080:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141014912:0@lo:400:kworker.0 00000100:00100000:1.0:1790100483.532120:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100483.532168:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790100483.532175:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141014528:0@lo:400:kworker.0 00000100:00100000:1.0:1790100483.532207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100483.532237:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141015040:0@lo:400:kworker.0 00000100:00100000:1.0:1790100483.532278:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100483.532319:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141014272 00000100:00100000:1.0:1790100483.532397:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141014272 00000100:00100000:1.0:1790100483.532460:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1790100483.532468:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:3641:x1877056141014272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100483.532536:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a2331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a237a43-d248-40fc-b145-fd7f23146511+19:3641:x1877056141014272:12345-0@lo:400:kworker.0 Request processed in 68us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100483.532572:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1790100483.532605:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141014912 00000100:00100000:1.0:1790100483.532609:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141014912 00000100:00100000:1.0:1790100483.532659:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790100483.532678:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141014912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100483.532721:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141014912:12345-0@lo:400:kworker.0 Request processed in 44us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100483.532727:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790100483.532755:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141014528 00000100:00100000:1.0:1790100483.532758:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141014528 00000100:00100000:1.0:1790100483.532788:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141015040 00000100:00100000:1.0:1790100483.532790:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141015040 00000100:00100000:1.0:1790100483.532804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790100483.532809:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1877056141014528:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790100483.532815:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790100483.532838:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1877056141014528:12345-0@lo:400:kworker.0 Request processed in 28us (630us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790100483.532844:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790100483.532854:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790100483.532857:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1877056141015040:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790100483.532861:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790100483.532877:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1877056141015040:12345-0@lo:400:kworker.0 Request processed in 19us (599us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790100483.532882:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:1.0:1790100483.532905:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100483.532938:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790100483.532942:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9261b2027000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790100483.532951:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1790100483.533039:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056141014784:0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533069:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100483.533089:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141015296:0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533108:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100483.533125:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790100483.533130:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056141014656:0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533145:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100483.533158:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141015168:0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533174:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100483.533194:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141014784 00000100:00100000:3.0:1790100483.533197:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141014784 00000100:00100000:3.0:1790100483.533220:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141014656 00000100:00100000:3.0:1790100483.533222:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141014656 00000100:00100000:3.0:1790100483.533229:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141015168 00000100:00100000:3.0:1790100483.533231:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141015168 00000100:00100000:3.0:1790100483.533243:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790100483.533254:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056141014784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533286:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056141014784:12345-0@lo:400:kworker.0 Request processed in 33us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100483.533292:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790100483.533303:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1790100483.533308:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056141015168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533329:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056141015168:12345-0@lo:400:kworker.0 Request processed in 21us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100483.533333:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1790100483.533358:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790100483.533362:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1877056141014656:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790100483.533366:0:12139:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790100483.533385:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1877056141014656:12345-0@lo:400:kworker.0 Request processed in 22us (238us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790100483.533389:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790100483.533411:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141015296 00000100:00100000:3.0:1790100483.533415:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141015296 00000100:00100000:3.0:1790100483.533479:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790100483.533496:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141015296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533592:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141015296:12345-0@lo:400:kworker.0 Request processed in 106us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100483.533598:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1790100483.533620:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100483.533623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790100483.533637:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790100483.533641:0:3644:0:(import.c:65:import_set_state_nolock()) ffff926082856000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790100483.533650:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790100483.533654:0:3644:0:(import.c:65:import_set_state_nolock()) ffff926082856000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790100483.533657:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 161 00000100:00080000:3.0:1790100483.533665:0:3644:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff926082856000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100483.533688:0:3644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083284a80 x1877056141015424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790100483.533710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1877056141014656:0@lo:400:kworker.0 00010000:00080000:3.0:1790100483.533723:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6254a80 x1877056141015168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100483.533734:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141015168:0@lo:400:kworker.0 00010000:00080000:3.0:1790100483.533742:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6257b80 x1877056141014784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100483.533750:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056141014784:0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533758:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141015296:0@lo:400:kworker.0 00000100:00100000:3.0:1790100483.533896:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056141015424:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790100483.533928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100483.533972:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141015424 00000100:00100000:3.0:1790100483.533976:0:12139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141015424 00000100:00100000:3.0:1790100483.534004:0:12139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790100483.534009:0:12139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1877056141015424:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1790100483.534034:0:12139:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790100483.534073:0:12139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1877056141015424:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 62us (143us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790100483.534088:0:12139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1790100483.534138:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926082856000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790100483.534142:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790100483.534155:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056141015424:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790100483.536483:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100483.536513:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141015552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100483.536606:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100483.536719:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141015552 00000100:00100000:2.0:1790100483.536726:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141015552 00000100:00100000:2.0:1790100483.536779:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790100483.536787:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141015552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790100483.536812:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100483.536888:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141015552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100483.536909:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790100483.536971:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141015552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100483.546022:0:7542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1877056141014400:12345-0@lo:38:kworker.0 Request processed in 16730us (16930us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790100483.546035:0:7542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1790100483.550924:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b8ed4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790100483.550936:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790100483.550942:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141014400:0@lo:38:kworker.0 00000100:00080000:1.0:1790100483.586149:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9261b2027000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100483.586162:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 148 00000100:00080000:1.0:1790100483.586175:0:3641:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9261b2027000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100483.586241:0:3641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926084c11880 x1877056141015680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100483.586269:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141014528:0@lo:400:kworker.0 00000100:00080000:1.0:1790100483.586298:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790100483.586302:0:3641:0:(import.c:65:import_set_state_nolock()) ffff926083162800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790100483.586305:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790100483.586308:0:3641:0:(import.c:65:import_set_state_nolock()) ffff926083162800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100483.586311:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 175 00000100:00080000:1.0:1790100483.586316:0:3641:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff926083162800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100483.586327:0:3641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926084c10700 x1877056141015808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100483.586351:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141015040:0@lo:400:kworker.0 00000100:00100000:1.0:1790100483.586364:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:3641:1877056141014272:0@lo:400:kworker.0 00000100:00100000:1.0:1790100483.586377:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141014912:0@lo:400:kworker.0 00000100:00100000:0.0:1790100483.586488:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877056141015680:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1790100483.586544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100483.586607:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056141015808:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1790100483.586630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100483.587646:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141015680 00000100:00100000:2.0:1790100483.587654:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141015680 00000100:00100000:2.0:1790100483.587690:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141015808 00000100:00100000:2.0:1790100483.587692:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141015808 00000100:00100000:2.0:1790100483.587721:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790100483.587729:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141015680:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1790100483.587743:0:9338:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790100483.587797:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141015680:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 68us (1253us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100483.587804:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790100483.587820:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790100483.587824:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141015808:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1790100483.587831:0:9338:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790100483.587853:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141015808:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28us (1222us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100483.587859:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1790100483.587884:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2027000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100483.587888:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790100483.587891:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877056141015680:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1790100483.587899:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083162800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100483.587901:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790100483.587904:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056141015808:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1790100483.912610:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100484.936860:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790100485.579820:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790100485.579829:0:8420:0:(genops.c:885:class_export_put()) final put ffff9261a62fc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790100485.579914:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a62fc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790100485.579967:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261a62f8000 for lustre-OST0000 00000001:00100000:0.0:1790100485.580054:0:6492:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790100485.580058:0:6492:0:(genops.c:885:class_export_put()) final put ffff9261b69b5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790100485.580207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1790100485.580258:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261b69b2800 for lustre-MDT0000 00000001:00100000:3.0:1790100485.580555:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790100485.580560:0:9503:0:(genops.c:885:class_export_put()) final put ffff926083b44800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790100485.580630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff926083b44800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790100485.580654:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083b42800 for lustre-OST0001 00000001:00100000:1.0:1790100485.581379:0:7441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790100485.581389:0:7441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1790100485.581404:0:7441:0:(genops.c:885:class_export_put()) final put ffff9261b69b0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790100485.581465:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1790100485.581504:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261b69b7800 for lustre-MDT0001 00010000:00010000:3.0:1790100485.960566:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790100486.345156:0:15188:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff926083a90e40 - data ffff92619e337288/ffff926083b3c800 00000020:01000000:0.0:1790100486.345316:0:15188:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9261a2f9c480 - data ffff92619e05b5e8/ffff9261c1b01800 00000001:00000004:0.0:1790100486.355156:0:15188:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1790100486.438431:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790100486.438439:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1790100486.438453:0:15188:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff926084c13480 x1877056141012992/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790100490 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100486.438478:0:15188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790100486.440362:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790100486.440367:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1790100486.440379:0:15188:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790100486.440381:0:15188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790100486.440864:0:8965:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790100486.440868:0:8965:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1790100486.440879:0:8965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790100486.443652:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790100486.443661:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1790100486.443712:0:15188:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790100486.443715:0:15188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790100486.444111:0:10088:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790100486.444121:0:10088:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790100486.444131:0:10088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1790100486.447656:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982866b0 00000020:00000080:3.0:1790100486.447670:0:15188:0:(genops.c:885:class_export_put()) final put ffff92618685f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790100486.448217:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92618685f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790100486.461053:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982866c5 00000020:00000080:1.0:1790100486.461066:0:15188:0:(genops.c:885:class_export_put()) final put ffff92618685a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790100486.461407:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1790100486.461413:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100486.461421:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790100486.461425:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff92618684cd40) has no exports 00000004:01000000:1.0:1790100486.461606:0:15188:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790100486.461615:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286b48 00000020:00000080:1.0:1790100486.461620:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261bf970000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790100486.466085:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92618685a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790100486.466279:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790100486.466297:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100486.466311:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790100486.466316:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9261b7973380) has no exports 00000020:00000080:1.0:1790100486.466324:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286b41 00000020:00000080:1.0:1790100486.466332:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261a631c000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1790100486.467112:0:15188:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790100486.467118:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790100486.467122:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1790100486.467128:0:15188:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790100486.467131:0:15188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790100486.467160:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100486.467169:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790100486.467176:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982869b9 00000020:00000080:1.0:1790100486.467182:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261a62f6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790100486.467185:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790100486.467189:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100486.467193:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790100486.467196:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9261b69a8000) has no exports 00000020:00000080:1.0:1790100486.467201:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982869b2 00000020:00000080:1.0:1790100486.467204:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261a62fa800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790100486.467962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261bf970000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790100486.467972:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a631c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790100486.467978:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261b777a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790100486.467985:0:36:0:(genops.c:885:class_export_put()) final put ffff926189d43800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790100486.467987:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff926189d43800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1790100486.467992:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790100486.468080:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a62f6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1790100486.468086:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a62fa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790100486.468191:0:15188:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790100486.468203:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790100486.468205:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1790100486.468209:0:15188:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790100486.468211:0:15188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790100486.468298:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100486.468305:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1790100486.468318:0:15188:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1790100486.468324:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286869 00000020:00000080:1.0:1790100486.468330:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261a613b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790100486.480671:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261a62fd800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1790100486.481065:0:36:0:(genops.c:885:class_export_put()) final put ffff9261bcab9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790100486.481070:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261bcab9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1790100486.481078:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790100486.482162:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1790100486.482268:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790100486.482280:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790100486.482284:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9261b7674d40) has no exports 00000020:00000080:0.0:1790100486.482300:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286862 00000020:00000080:0.0:1790100486.482308:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261b2038000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790100486.484612:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a613b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790100486.485552:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b2038000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790100486.496374:0:15188:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1790100486.496382:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790100486.496386:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1790100486.496394:0:15188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790100486.496454:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100486.496466:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790100486.496494:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100486.496497:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790100486.496504:0:15188:0:(genops.c:885:class_export_put()) final put ffff926189d40000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790100486.496508:0:15188:0:(genops.c:844:class_export_destroy()) destroying export ffff926189d40000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790100486.496519:0:15188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790100486.496838:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982866cc 00000020:00000080:1.0:1790100486.496846:0:15188:0:(genops.c:885:class_export_put()) final put ffff926186859000/lustre-MDD0000_UUID 00000020:01000000:1.0:1790100486.496851:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790100486.496856:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100486.496860:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790100486.496864:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff926186848000) has no exports 00000020:00000080:1.0:1790100486.496887:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100486.496894:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790100486.496901:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982866d3 00000020:00000080:1.0:1790100486.496906:0:15188:0:(genops.c:885:class_export_put()) final put ffff92618685e000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790100486.496913:0:15188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff926187007800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790100486.496966:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261b203f000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790100486.496974:0:36:0:(genops.c:885:class_export_put()) final put ffff92618685f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790100486.496976:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92618685f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1790100486.496981:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000004:1.0:1790100486.497104:0:15188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff926187007800 3 00000020:01000004:1.0:1790100486.497108:0:15188:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff926187007800 from lustre-MDT0000 00000020:00000080:1.0:1790100486.497137:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100486.497141:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790100486.497144:0:15188:0:(genops.c:885:class_export_put()) final put ffff926186858000/lustre-MDT0000_UUID 00000020:00000080:1.0:1790100486.497147:0:15188:0:(genops.c:844:class_export_destroy()) destroying export ffff926186858000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790100486.497154:0:15188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790100486.497186:0:15188:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1790100486.497189:0:15188:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790100486.497192:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790100486.497194:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100486.497197:0:15188:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790100486.497203:0:15188:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9261a2397000 2a237a43-d248-40fc-b145-fd7f23146511 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790100486.497207:0:15188:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9261b23019c0) has exports, disconnecting them 00000020:00080000:1.0:1790100486.497211:0:15188:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9261a2397000), last request at 1790100285 00000020:00000080:1.0:1790100486.497225:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286671 00000020:00010000:1.0:1790100486.497229:0:15188:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9261a2397000: total 2 00000100:00080000:1.0:1790100486.497232:0:15188:0:(import.c:65:import_set_state_nolock()) ffff9261a2391800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790100486.497244:0:15188:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9261a2397000): rc 0 00000020:00080000:1.0:1790100486.497247:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9261b23019c0) has no exports 00000100:00100000:1.0:1790100486.497312:0:6507:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9261b2370c00:6507] 2 exiting: rc = 0 00000020:00000080:3.0:1790100486.497390:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff926186859000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1790100486.497394:0:36:0:(genops.c:885:class_export_put()) final put ffff92618685e800/lustre-MDD0000_UUID 00000020:00000080:3.0:1790100486.497396:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92618685e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1790100486.497406:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1790100486.497621:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92618685e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1790100486.497635:0:6505:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9261b2370e00:6505] 0 exiting: rc = 1 00000100:00100000:1.0:1790100486.497677:0:6506:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9261b2370200:6506] 1 exiting: rc = 0 00000100:00100000:1.0:1790100486.497736:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497754:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497761:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497766:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497772:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497777:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497783:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497788:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497794:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497807:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497813:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497820:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497827:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497833:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497839:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497847:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497854:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497860:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497865:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497872:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497877:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497883:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497888:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497893:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497898:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497904:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497909:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497915:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497921:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497928:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497933:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497940:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497945:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497951:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497956:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497961:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497967:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497973:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497978:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497984:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497990:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.497996:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498061:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498065:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498076:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498081:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498086:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498091:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498132:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498137:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498141:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498146:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498151:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498156:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498161:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498165:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498170:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498175:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498179:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498184:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498189:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498194:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498199:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100486.498204:0:15188:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1790100486.499011:0:7461:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9261a2397000: total 0 00010000:00010000:1.0:1790100486.499057:0:7461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9261a2397000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790100486.499085:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59600/0xc87a4f2298286bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286be9 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499213:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6800/0xc87a4f2298286e0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286e04 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499226:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7c00/0xc87a4f2298286b9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286b95 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499235:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7000/0xc87a4f2298286e19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286e12 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499548:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565d000/0xc87a4f2298286b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286b87 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499560:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189917e00/0xc87a4f2298286adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286ad8 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499623:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59c00/0xc87a4f229828676d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286766 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499637:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7600/0xc87a4f2298286bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286bbf expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499645:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6000/0xc87a4f2298286e27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286e20 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499655:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e58600/0xc87a4f2298286bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286bb1 expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499663:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083e47200/0xc87a4f2298286c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286c2f expref: 4 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499671:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926189916e00/0xc87a4f229828677b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286774 expref: 3 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499681:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a2e59200/0xc87a4f2298286be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc87a4f2298286bdb expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100486.499809:0:7461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9261a2397000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1790100486.499825:0:7461:0:(genops.c:885:class_export_put()) final put ffff9261a2397000/2a237a43-d248-40fc-b145-fd7f23146511 00010000:00010000:1.0:1790100486.499872:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100486.499882:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100486.499884:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790100486.506947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a2397000/2a237a43-d248-40fc-b145-fd7f23146511 for MGS 00000020:00000080:3.0:1790100486.507041:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261a2391800 for MGS 00000020:01000000:1.0:1790100486.515054:0:15188:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92608389f2a0 - data ffff92619e345288/ffff926083b99000 00000020:01000000:1.0:1790100486.515214:0:15188:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9261a2f9c180 - data ffff9261821e4d80/ffff9261922ce400 00000020:00000080:1.0:1790100486.516879:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286655 00000020:00000080:1.0:1790100486.520179:0:15188:0:(genops.c:885:class_export_put()) final put ffff926184c03000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790100486.520235:0:15188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff926187007800 from MGS, refs=2 00000020:01000004:1.0:1790100486.520240:0:15188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff926187007800 2 00000020:01000004:1.0:1790100486.520243:0:15188:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff926187007800 from MGS 00000020:00000080:1.0:1790100486.520754:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100486.520763:0:15188:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790100486.520768:0:15188:0:(genops.c:885:class_export_put()) final put ffff926184c05800/MGS 00000020:00000080:1.0:1790100486.520771:0:15188:0:(genops.c:844:class_export_destroy()) destroying export ffff926184c05800/MGS for MGS 00000020:01000000:1.0:1790100486.520788:0:15188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790100486.520856:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790100486.520860:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100486.520865:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790100486.520871:0:15188:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9261c198f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790100486.520877:0:15188:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9261868499c0) has exports, disconnecting them 00000020:00080000:1.0:1790100486.520882:0:15188:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9261c198f800), last request at 1790100285 00000020:00000080:1.0:1790100486.520887:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286720 00000020:00080000:1.0:1790100486.520898:0:15188:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9261c198f800): rc 0 00000020:00000080:1.0:1790100486.520902:0:15188:0:(genops.c:885:class_export_put()) final put ffff9261c198f800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790100486.522125:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926184c03000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790100486.522137:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261c198f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790100486.568185:0:15188:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790100486.568194:0:15188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790100486.568198:0:15188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790100486.568204:0:15188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790100486.568291:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261c1989800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790100486.568405:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100486.568413:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790100486.568419:0:15188:0:(genops.c:885:class_export_put()) final put ffff92618685c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790100486.568424:0:15188:0:(genops.c:844:class_export_destroy()) destroying export ffff92618685c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790100486.568441:0:15188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790100486.568615:0:15188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff926187007800 1 00000020:00000080:1.0:1790100486.568622:0:15188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286647 00000020:00000080:1.0:1790100486.568629:0:15188:0:(genops.c:885:class_export_put()) final put ffff926184c02800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790100486.568642:0:15188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790100486.568646:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100486.568651:0:15188:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790100486.568654:0:15188:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9261b5ab3380) has no exports 00000020:00000080:3.0:1790100486.568716:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926184c02800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1790100486.600653:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141015936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790100486.600724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100486.600796:0:12048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141015936 00000100:00100000:3.0:1790100486.600802:0:12048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141015936 00000100:00100000:3.0:1790100486.600848:0:12048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790100486.600856:0:12048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141015936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100486.600883:0:12048:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790100486.600927:0:12048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141015936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100486.600934:0:12048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1790100486.600954:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100486.600986:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141015936:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1790100486.657159:0:15188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100486.657171:0:15188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790100486.657177:0:15188:0:(genops.c:885:class_export_put()) final put ffff926187007000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790100486.657182:0:15188:0:(genops.c:844:class_export_destroy()) destroying export ffff926187007000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790100486.657192:0:15188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790100486.657559:0:15188:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff926187001800 00000020:02000400:3.0:1790100486.657616:0:15188:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1790100486.986510:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100488.012448:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100488.651615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790100488.651621:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790100488.651625:0:36:0:(import.c:65:import_set_state_nolock()) ffff9261b8ed4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100488.651633:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 334 00000100:00080000:0.0:1790100488.651639:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790100488.651648:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9261b8ed4800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100488.651681:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6254700 x1877056141016192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100488.651696:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790100488.651708:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790100488.651709:0:36:0:(import.c:65:import_set_state_nolock()) ffff9261b2027000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100488.651713:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 334 00000100:00080000:0.0:1790100488.651716:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790100488.651721:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9261b2027000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100488.651743:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6257480 x1877056141016320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100488.651753:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790100488.651756:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790100488.651757:0:36:0:(import.c:65:import_set_state_nolock()) ffff926082856000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100488.651774:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 334 00000100:00080000:0.0:1790100488.651777:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790100488.651782:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff926082856000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100488.651797:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6254e00 x1877056141016448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100488.651829:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790100488.651832:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790100488.651834:0:36:0:(import.c:65:import_set_state_nolock()) ffff926083162800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100488.651837:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 334 00000100:00080000:0.0:1790100488.651840:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790100488.651849:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff926083162800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100488.651861:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6255c00 x1877056141016832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100488.651910:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056141016576:0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.651973:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100488.652023:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790100488.652030:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056141016064:0@lo:400:kworker.0 00000400:00000100:0.0:1790100488.652048:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877056141016064 offset 0 length 224: 4 00000100:00100000:0.0:1790100488.652066:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141017088:0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.652090:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100488.652117:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141016704:0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.652138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100488.652155:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100488.652160:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056141016960:0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.652191:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100488.652221:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141016576 00000100:00100000:0.0:1790100488.652229:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141016576 00000100:00100000:0.0:1790100488.652274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141016960 00000100:00100000:0.0:1790100488.652277:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141016960 00000100:00100000:0.0:1790100488.652510:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790100488.652519:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056141016576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.652565:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056141016576:12345-0@lo:400:kworker.0 Request processed in 47us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100488.652572:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790100488.652585:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790100488.652591:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056141016960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.652616:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877056141016960:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100488.652621:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790100488.652637:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141017088 00000100:00100000:0.0:1790100488.652640:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141017088 00000100:00100000:0.0:1790100488.652661:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141016704 00000100:00100000:0.0:1790100488.652795:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141016704 00000100:00100000:0.0:1790100488.652820:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790100488.652825:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141017088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.652855:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141017088:12345-0@lo:400:kworker.0 Request processed in 30us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100488.652861:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790100488.652872:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790100488.652877:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141016704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.652902:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141016704:12345-0@lo:400:kworker.0 Request processed in 26us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100488.652915:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1790100488.652934:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100488.652938:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100488.652940:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790100488.652977:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9261a6255880 x1877056141016960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100488.652990:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056141016960:0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.653002:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141016704:0@lo:400:kworker.0 00000100:00100000:0.0:1790100488.653033:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141017088:0@lo:400:kworker.0 00010000:00080000:0.0:1790100488.653043:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9261a6254000 x1877056141016576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100488.653050:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056141016576:0@lo:400:kworker.0 00000100:00100000:2.0:1790100488.653215:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141016192:0@lo:38:kworker.0 00000100:00100000:2.0:1790100488.653248:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100488.653271:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877056141016320:0@lo:38:kworker.0 00000100:00100000:2.0:1790100488.653293:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100488.653311:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056141016448:0@lo:38:kworker.0 00000100:00100000:2.0:1790100488.653329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100488.653364:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056141016832:0@lo:38:kworker.0 00000100:00100000:2.0:1790100488.653395:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100488.653423:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141016320 00000100:00100000:2.0:1790100488.653427:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141016320 00000100:00100000:2.0:1790100488.653445:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141016448 00000100:00100000:2.0:1790100488.653448:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141016448 00000100:00100000:2.0:1790100488.653455:0:9338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141016832 00000100:00100000:2.0:1790100488.653457:0:9338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141016832 00000100:00100000:2.0:1790100488.653465:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790100488.653470:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141016320:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790100488.653486:0:9338:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790100488.653514:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141016320:12345-0@lo:38:kworker.0 Request processed in 43us (220us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100488.653519:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790100488.653530:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1790100488.653533:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141016448:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790100488.653541:0:9338:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790100488.653562:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141016448:12345-0@lo:38:kworker.0 Request processed in 27us (231us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100488.653576:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1790100488.653588:0:9338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790100488.653592:0:9338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141016832:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790100488.653600:0:9338:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790100488.653620:0:9338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1877056141016832:12345-0@lo:38:kworker.0 Request processed in 27us (225us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100488.653625:0:9338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790100488.653638:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141016192 00000100:00100000:2.0:1790100488.653641:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141016192 00000100:00100000:2.0:1790100488.653656:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790100488.653660:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1877056141016192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790100488.653681:0:6517:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790100488.654144:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1877056141016192:12345-0@lo:38:kworker.0 Request processed in 481us (894us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100488.654151:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1790100488.654200:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b8ed4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100488.654205:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790100488.654209:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141016192:0@lo:38:kworker.0 00000100:00080000:2.0:1790100488.654216:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2027000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100488.654219:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790100488.654222:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877056141016320:0@lo:38:kworker.0 00000100:00080000:2.0:1790100488.654229:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926082856000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100488.654233:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790100488.654235:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056141016448:0@lo:38:kworker.0 00000100:00080000:2.0:1790100488.654256:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083162800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100488.654259:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790100488.654261:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056141016832:0@lo:38:kworker.0 00000100:00100000:1.0:1790100488.654587:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141017216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100488.654618:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100488.655907:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141017216 00000100:00100000:2.0:1790100488.655916:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141017216 00000100:00100000:2.0:1790100488.655962:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790100488.655971:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141017216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790100488.655998:0:8428:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790100488.667513:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141017216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11533us (12883us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100488.667528:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790100488.679165:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141017216:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790100489.049137:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100490.071503:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100491.082836:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100491.723105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141017344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790100491.723171:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100491.723572:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141017344 00000100:00100000:3.0:1790100491.723579:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141017344 00000100:00100000:3.0:1790100491.723636:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790100491.723651:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141017344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100491.723677:0:8429:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790100491.723731:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141017344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100491.723738:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790100491.723782:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141017344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790100491.726382:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1790100491.906606:0:15390:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790100491.936239:0:15390:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1790100491.936791:0:15390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.936806:0:15390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.936814:0:15390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.936821:0:15390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.936840:0:15390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790100491.936845:0:15390:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790100491.936867:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790100491.936872:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790100491.936878:0:15390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790100491.936895:0:15390:0:(import.c:65:import_set_state_nolock()) ffff9261b2027000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1790100491.936900:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790100491.936901:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790100491.936904:0:15390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790100491.937387:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100491.937395:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.937403:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100491.937407:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.937417:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100491.937424:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100491.937430:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100491.937432:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790100491.937441:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790100491.937476:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.937483:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100491.937516:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.937525:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298286bdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286be2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.937537:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100491.937539:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100491.937541:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100491.937762:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056141017472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100491.937825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100491.937896:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141017472 00000100:00100000:3.0:1790100491.937903:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141017472 00000100:00100000:3.0:1790100491.937944:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790100491.937952:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1877056141017472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790100491.937958:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790100491 with bad export cookie 14445945764744554097 00010000:00010000:1.0:1790100491.949128:0:15390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.949147:0:15390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.949153:0:15390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.949160:0:15390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.949322:0:15390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100491.949402:0:15390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.949412:0:15390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.949418:0:15390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.949424:0:15390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957754:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100491.957769:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957781:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59e00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100491.957786:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957797:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100491.957805:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100491.957812:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100491.957814:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1790100491.957854:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957877:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100491.957901:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957908:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59e00/0xc87a4f2298286be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286bf0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957923:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100491.957926:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957941:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926189916c00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100491.957945:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957951:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100491.957958:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100491.957963:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100491.957966:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1790100491.957978:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.957985:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100491.957990:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100491.958020:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100491.958022:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100491.958024:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100491.958044:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056141017600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100491.958110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100491.958160:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100491.958165:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056141017728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100491.958186:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100491.958214:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141017600 00000100:00100000:2.0:1790100491.958221:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141017600 00000100:00100000:2.0:1790100491.958259:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141017728 00000100:00100000:2.0:1790100491.958262:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141017728 00000100:00100000:2.0:1790100491.958277:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790100491.958284:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926184250050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1877056141017600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790100491.958290:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790100491 with bad export cookie 14445945764744554097 00000100:00100000:2.0:1790100491.958331:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926184250050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1877056141017600:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (221us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790100491.958359:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790100491.958375:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790100491.958380:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1877056141017728:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790100491.958383:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790100491 with bad export cookie 14445945764744554097 00000100:00100000:2.0:1790100491.958407:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1877056141017728:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (220us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790100491.958412:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790100491.958445:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790100491.958449:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9261862ca000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790100491.958459:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1790100491.961387:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1877056141017472:12345-0@lo:103:ldlm_bl.0 Request processed in 23429us (23557us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790100491.961399:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790100491.962299:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1790100491.962631:0:15390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790100491.962661:0:15390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926189916c00/0xc87a4f2298286ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286adf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100491.962683:0:15390:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790100491.964364:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100491.982419:0:15390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.982436:0:15390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.982443:0:15390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.982449:0:15390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.982480:0:15390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100491.982489:0:15390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.982497:0:15390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.982503:0:15390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.982510:0:15390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100491.982526:0:15390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1790100491.982531:0:15390:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1790100491.982549:0:15390:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1790100491.982586:0:15390:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1790100491.982590:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1790100491.982594:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100491.982599:0:15390:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1790100491.982606:0:15390:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff926083b47000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790100491.982611:0:15390:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff926082855000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790100491.982627:0:15390:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9261b69acd40) has exports, disconnecting them 00000020:00080000:1.0:1790100491.982632:0:15390:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff926083b47000), last request at 1790100488 00000020:00000080:1.0:1790100491.982639:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a53 00000100:00080000:1.0:1790100491.982662:0:15390:0:(import.c:65:import_set_state_nolock()) ffff926083b41800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790100491.982713:0:15390:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff926083b47000): rc 0 00000020:00000080:1.0:1790100491.982716:0:15390:0:(genops.c:885:class_export_put()) final put ffff926083b47000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1790100491.982727:0:15390:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff926082855000), last request at 1790100488 00000020:00000080:1.0:1790100491.982730:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f229828692d 00000100:00080000:1.0:1790100491.982735:0:15390:0:(import.c:65:import_set_state_nolock()) ffff926082854800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790100491.982741:0:15390:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff926082855000): rc 0 00000020:00000080:1.0:1790100491.982743:0:15390:0:(genops.c:885:class_export_put()) final put ffff926082855000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1790100491.982749:0:15390:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbae481d03ae0 00000100:00080000:1.0:1790100491.982767:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790100491.982776:0:15390:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff926083c54a80 x1877056141014016/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790100498 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100491.982787:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1790100491.983404:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100491.983412:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100491.983420:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6c00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100491.983433:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100491.983442:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100491.983450:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100491.983456:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790100491.983458:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790100491.983460:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:1.0:1790100491.983871:0:15390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790100491.983876:0:15390:0:(import.c:65:import_set_state_nolock()) ffff9261b8ed4800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1790100491.983995:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790100491.983999:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1790100491.984012:0:15390:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790100491.984128:0:15390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790100491.984147:0:15390:0:(import.c:65:import_set_state_nolock()) ffff9261b2024800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790100491.984163:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790100491.984165:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1790100491.984178:0:15390:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790100491.984235:0:15390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790100491.984243:0:15390:0:(import.c:65:import_set_state_nolock()) ffff9261bf974800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790100491.985068:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9261b69acd40) has no exports 00000100:00080000:2.0:1790100491.997899:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.113@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790100491.997904:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790100491.997914:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9261a6254380 x1877056141016064/t0(0) o400->MGC192.168.203.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790100504 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100491.998038:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c56680 x1877056141017472/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790100507 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100491.998049:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c54380 x1877056141017600/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790100507 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100491.998058:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c56300 x1877056141017728/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790100507 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790100491.998066:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790100491.998069:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790100491.998070:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790100491.998107:0:3642:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9261862ca000 already not connected (conn 1, was 1): DISCONN 00000020:00000080:0.0:1790100491.998223:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926083b47000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:3.0:1790100491.999950:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100491.999962:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100491.999989:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100491.999998:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298286e20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc87a4f2298286e27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100492.000016:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100492.000022:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100492.000029:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261c2179c00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100492.000033:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100492.000043:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100492.000064:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100492.000069:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790100492.000072:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790100492.000075:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790100492.000087:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:3.0:1790100492.000090:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100492.000096:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261c2179c00/0xc87a4f2298286774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f229828677b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100492.000110:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100492.000111:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100492.000113:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100492.000139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a237a43-d248-40fc-b145-fd7f23146511:0:1877056141018112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100492.000163:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790100492.000396:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926082855000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1790100492.000429:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083b41800 for lustre-MDT0001 00000020:00000080:0.0:1790100492.000434:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926082854800 for lustre-MDT0001 00000100:00100000:0.0:1790100492.000445:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a237a43-d248-40fc-b145-fd7f23146511:3642:1877056141017472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100492.001330:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a237a43-d248-40fc-b145-fd7f23146511:3644:1877056141016064:0@lo:400:kworker.0 00000100:00080000:2.0:1790100492.002055:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9261862ca000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100492.002062:0:3643:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 136 00000100:00080000:2.0:1790100492.002074:0:3643:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff9261862ca000 using connection 192.168.203.113@tcp/0@lo 00010000:00010000:2.0:1790100492.002084:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100492.002099:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141017856:0@lo:9:umount.0 00000100:00100000:2.0:1790100492.002159:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100492.002212:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141017984:0@lo:9:umount.0 00000100:00100000:2.0:1790100492.002244:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100492.002681:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c56d80 x1877056141018240/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100492.002717:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a237a43-d248-40fc-b145-fd7f23146511:3640:1877056141018240:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1790100492.002739:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877056141018240 offset 0 length 520: 4 00000100:00100000:2.0:1790100492.002770:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056141017600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100492.002789:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141014016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100492.002806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a237a43-d248-40fc-b145-fd7f23146511:3643:1877056141017728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100492.003194:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141017856 00000100:00100000:0.0:1790100492.003207:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141017856 00000100:00100000:0.0:1790100492.003358:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141017984 00000100:00100000:0.0:1790100492.003362:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141017984 00000100:00080000:2.0:1790100492.003421:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100492.003568:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790100492.003579:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877056141017856:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790100492.003603:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f229828697a 00000100:00080000:1.0:1790100492.003611:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9261a613b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100492.003766:0:8427:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1790100492.004208:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1877056141017856:12345-0@lo:9:umount.0 Request processed in 630us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100492.004216:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790100492.004360:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790100492.004369:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877056141017984:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790100492.004383:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286b09 00000100:00080000:1.0:1790100492.004389:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9261bf975800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100492.004410:0:8427:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1790100492.004490:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1877056141017984:12345-0@lo:9:umount.0 Request processed in 122us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100492.004497:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1790100492.004557:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100492.004564:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790100492.004819:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2024800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790100492.004863:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790100492.004935:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100492.004940:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141017856:0@lo:9:umount.0 00000100:00080000:2.0:1790100492.004953:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261bf974800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790100492.004968:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790100492.004970:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100492.004980:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141017984:0@lo:9:umount.0 00000020:00080000:2.0:1790100492.009573:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9261b69acd40) has no exports 00010000:00010000:3.0:1790100492.105193:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790100492.115147:0:15390:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9260823872a0 - data ffff92619e335438/ffff9261a62c6000 00000020:01000000:3.0:1790100492.115304:0:15390:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9261c1a2f060 - data ffff92619e1d5948/ffff9261a60c1800 00000001:00000004:2.0:1790100492.130796:0:15390:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1790100492.198538:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790100492.198546:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1790100492.198554:0:15390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790100492.204150:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790100492.204158:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1790100492.204183:0:15390:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100492.204186:0:15390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790100492.205439:0:8960:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790100492.205453:0:8960:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1790100492.205466:0:8960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790100492.206796:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790100492.206802:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1790100492.206817:0:15390:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100492.206820:0:15390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790100492.208186:0:10084:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790100492.208193:0:10084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1790100492.208205:0:10084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1790100492.210038:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286797 00000020:00000080:2.0:1790100492.210048:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b69b6800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790100492.210548:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1790100492.213974:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982867ac 00000020:00000080:2.0:1790100492.213987:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b69b5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790100492.214018:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1790100492.214024:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100492.214031:0:15390:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790100492.214035:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9261b69a99c0) has no exports 00000020:00000080:3.0:1790100492.214136:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1790100492.214199:0:15390:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790100492.214208:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286b02 00000020:00000080:2.0:1790100492.214213:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261bf971000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790100492.214228:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790100492.214231:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100492.214239:0:15390:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790100492.214242:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9261b79fb380) has no exports 00000020:00000080:3.0:1790100492.214247:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9261bf971000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1790100492.214248:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286afb 00000020:00000080:2.0:1790100492.214254:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261bf975000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790100492.214270:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9261bf975000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790100492.214616:0:15390:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790100492.214621:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790100492.214624:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1790100492.214630:0:15390:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100492.214632:0:15390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790100492.214675:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100492.214682:0:15390:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790100492.214687:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286973 00000020:00000080:2.0:1790100492.214691:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261a6319000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790100492.214695:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790100492.214698:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100492.214702:0:15390:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1790100492.214715:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261bf974800 for lustre-OST0001-osc-MDT0001 00000020:00080000:2.0:1790100492.214715:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9261b5ab4d40) has no exports 00000020:00000080:2.0:1790100492.214722:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f229828696c 00000020:00000080:3.0:1790100492.214726:0:38:0:(genops.c:885:class_export_put()) final put ffff926082853800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790100492.214727:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b2021800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790100492.214740:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926082853800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1790100492.214750:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790100492.214843:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a6319000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790100492.214852:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b2021800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790100492.215079:0:15390:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790100492.215082:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790100492.215084:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1790100492.215088:0:15390:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100492.215097:0:15390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790100492.215134:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790100492.215135:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261b2024800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1790100492.215141:0:15390:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790100492.215146:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261a622f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790100492.215149:0:15390:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a622f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1790100492.215153:0:15390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1790100492.215205:0:15390:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790100492.215211:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982867cf 00000020:00000080:2.0:1790100492.215215:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b777a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790100492.215229:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1790100492.215233:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100492.215236:0:15390:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790100492.215239:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9261b7670000) has no exports 00000020:00000080:2.0:1790100492.215243:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982867c8 00000020:00000080:2.0:1790100492.215246:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b8ed5000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790100492.215254:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b777a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790100492.215271:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b8ed5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790100492.217409:0:15390:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1790100492.217416:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790100492.217420:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1790100492.217428:0:15390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790100492.217488:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100492.217498:0:15390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790100492.217527:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100492.217529:0:15390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790100492.217535:0:15390:0:(genops.c:885:class_export_put()) final put ffff926186858800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790100492.217539:0:15390:0:(genops.c:844:class_export_destroy()) destroying export ffff926186858800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1790100492.217545:0:15390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790100492.217716:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982867b3 00000020:00000080:3.0:1790100492.217721:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b69b4000/lustre-MDD0001_UUID 00000020:01000000:3.0:1790100492.217725:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1790100492.217977:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790100492.217982:0:15390:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790100492.217985:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9261b69ab380) has no exports 00000020:00000080:3.0:1790100492.218001:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100492.218003:0:15390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1790100492.218014:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982867ba 00000020:00000080:3.0:1790100492.218017:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b69b2000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1790100492.218023:0:15390:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261b2026000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1790100492.218025:0:15390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b2026000 2 00000020:01000004:3.0:1790100492.218027:0:15390:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9261b2026000 from lustre-MDT0001 00000020:00000080:3.0:1790100492.218040:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100492.218042:0:15390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1790100492.218044:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b69b1800/lustre-MDT0001_UUID 00000020:00000080:3.0:1790100492.218045:0:15390:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b1800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1790100492.218051:0:15390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1790100492.218079:0:15390:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1790100492.218083:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1790100492.218085:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790100492.218088:0:15390:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790100492.218094:0:15390:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff92618685c800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790100492.218098:0:15390:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9261b76719c0) has exports, disconnecting them 00000020:00080000:3.0:1790100492.218115:0:15390:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff92618685c800), last request at 1790100297 00000020:00000080:3.0:1790100492.218118:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f229828680e 00000020:00080000:3.0:1790100492.218128:0:15390:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff92618685c800): rc 0 00000020:00000080:3.0:1790100492.218131:0:15390:0:(genops.c:885:class_export_put()) final put ffff92618685c800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790100492.219527:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261b8ed4800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790100492.219538:0:37:0:(genops.c:885:class_export_put()) final put ffff9261b2025000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790100492.219540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b2025000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1790100492.219547:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790100492.219648:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b4000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1790100492.219652:0:37:0:(genops.c:885:class_export_put()) final put ffff9261b69b1000/lustre-MDD0001_UUID 00000020:00000080:0.0:1790100492.219653:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b1000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1790100492.219657:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1790100492.219856:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b69b2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790100492.219861:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92618685c800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1790100492.235442:0:15390:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1790100492.235450:0:15390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790100492.235455:0:15390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790100492.235462:0:15390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790100492.235486:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261b2027000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790100492.235653:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790100492.235662:0:15390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1790100492.235668:0:15390:0:(genops.c:885:class_export_put()) final put ffff92618685b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1790100492.235671:0:15390:0:(genops.c:844:class_export_destroy()) destroying export ffff92618685b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1790100492.235679:0:15390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1790100492.235755:0:15390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b2026000 1 00000020:00000080:0.0:1790100492.235761:0:15390:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f229828674a 00000020:00000080:0.0:1790100492.235767:0:15390:0:(genops.c:885:class_export_put()) final put ffff926186859800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1790100492.235786:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1790100492.235794:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926186859800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790100492.235803:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790100492.235808:0:15390:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790100492.235811:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9261b2300000) has no exports 00000020:00000080:0.0:1790100492.326070:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790100492.326082:0:15390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1790100492.326087:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b2021000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790100492.326092:0:15390:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b2021000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1790100492.326103:0:15390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1790100492.326210:0:15390:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9261b2023800 00000020:01000000:0.0:1790100492.326228:0:15390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1790100492.326232:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790100492.326236:0:15390:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790100492.326240:0:15390:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9261b2303380) has no exports 00000100:00100000:2.0:1790100492.326583:0:9338:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9260823e7200:9338] 3 exiting: rc = 0 00000100:00100000:2.0:1790100492.326954:0:6514:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff926194794400:6514] 2 exiting: rc = 0 00000100:00100000:2.0:1790100492.327033:0:6513:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9261b8ee8c00:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1790100492.327096:0:12139:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff926083e37800:12139] 4 exiting: rc = 0 00000100:00100000:2.0:1790100492.327369:0:6512:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9261b8ee9600:6512] 0 exiting: rc = 1 00000100:00100000:1.0:1790100492.337580:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337592:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337608:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337614:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337620:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337626:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337631:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337637:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337649:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337655:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337660:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337665:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337671:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337676:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337681:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337688:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337693:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337699:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337713:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337719:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337724:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337728:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337734:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337739:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337744:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337750:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337755:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337760:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337766:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337771:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337776:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337782:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337788:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337793:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337799:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337806:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337811:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337823:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337828:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337834:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337840:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337845:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337851:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337857:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337863:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337868:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337873:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337879:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337885:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337891:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337897:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337902:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337908:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337913:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337918:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337933:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337939:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337945:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337950:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337956:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337961:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337966:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337972:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.337977:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100492.340434:0:6515:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff92619229a600:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1790100492.342608:0:6516:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9261b2370800:6516] 1 exiting: rc = 0 00000100:00100000:1.0:1790100492.342812:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342821:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342827:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342833:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342840:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342846:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342853:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342859:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342877:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342882:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342888:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342893:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342904:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342909:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342914:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342920:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342936:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342942:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342947:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342952:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342957:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342962:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342968:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342973:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342979:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342986:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342991:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.342996:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343001:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343006:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343012:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343017:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343022:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343028:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343034:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343039:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343044:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343050:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343055:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343060:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343066:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343070:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343076:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343089:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343095:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343100:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343106:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343111:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343116:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343121:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343126:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343131:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343135:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343140:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343146:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343151:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343156:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343161:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343166:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343171:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343176:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343181:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343186:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.343190:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100492.345455:0:6517:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9261b20d8000:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1790100492.347325:0:6518:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff926194497200:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1790100492.347663:0:7542:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9261a6119400:7542] 2 exiting: rc = 0 00000100:00100000:0.0:1790100492.347775:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347785:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347790:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347796:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347802:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347808:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347813:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347827:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347835:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347840:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347847:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347853:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347858:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347864:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347870:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347876:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347895:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347901:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347908:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347938:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347945:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347951:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347957:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347963:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347968:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347979:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347985:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347992:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.347998:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348006:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348012:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348034:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348043:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348051:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348057:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348063:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348069:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348075:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348080:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348086:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348093:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348099:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348106:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348125:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348132:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348138:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348143:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348149:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348154:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348160:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348165:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348178:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348183:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348189:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348194:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348214:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348222:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348228:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348234:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348241:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348246:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348252:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348258:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100492.348263:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.367600:0:6519:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff926194493c00:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1790100492.371610:0:6520:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff926194493600:6520] 1 exiting: rc = 0 00000100:00100000:1.0:1790100492.371988:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.371996:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372001:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372006:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372010:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372015:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372020:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372024:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372029:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372034:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372038:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372044:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372063:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372068:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372073:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372077:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372082:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372087:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372091:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372096:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372101:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372107:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372112:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372117:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372122:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372127:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372131:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372136:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372141:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372146:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372150:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372154:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372159:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372163:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372167:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372171:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372175:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372179:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372184:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372189:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372193:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372198:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372202:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372207:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372211:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372216:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372221:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372233:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372237:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372242:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372247:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372252:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372257:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372262:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372266:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372271:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372276:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372281:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372286:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372291:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372296:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372302:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372306:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.372312:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.372810:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff926194493a00:6521] 0 exiting: rc = 1 00000100:00100000:0.0:1790100492.373038:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff926194493000:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1790100492.374194:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374202:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374207:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374213:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374218:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374224:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374229:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374235:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374240:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374245:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374249:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374255:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374260:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374264:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374268:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374273:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374278:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374283:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374302:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374307:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374312:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374317:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374321:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374325:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374330:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374334:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374443:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374450:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374455:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374461:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374466:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374471:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374476:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374480:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374486:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374491:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374496:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374501:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374506:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374511:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374515:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374520:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374525:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374530:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374534:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374539:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374544:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374549:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374554:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374559:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374564:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374568:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374573:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374584:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374588:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374593:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374598:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374602:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374608:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374612:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374617:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374621:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374626:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.374630:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.378882:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff926194492600:6524] 1 exiting: rc = 0 00000100:00100000:1.0:1790100492.378992:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff926194492800:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1790100492.379075:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379084:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379089:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379094:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379098:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379104:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379109:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379114:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379118:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379123:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379139:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379144:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379149:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379153:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379158:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379163:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379168:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379173:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379178:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379183:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379188:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379193:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379199:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379203:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379208:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379212:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379217:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379222:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379227:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379232:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379238:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379243:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379248:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379253:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379258:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379262:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379267:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379272:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379276:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379282:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379287:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379292:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379297:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379302:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379306:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379319:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379323:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379329:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379334:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379363:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379370:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379376:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379381:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379385:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379391:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379396:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379401:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379405:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379410:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379415:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379420:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379425:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379430:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100492.379435:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380091:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff926194493800:6525] 0 exiting: rc = 1 00000100:00100000:0.0:1790100492.380431:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff926194492a00:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1790100492.380605:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9261a22b2c00:6527] 2 exiting: rc = 0 00000100:00100000:1.0:1790100492.380753:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380760:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380766:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380772:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380778:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380783:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380789:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380795:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380800:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380806:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380811:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380817:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380823:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380828:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380834:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380839:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380845:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380850:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380857:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380872:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380880:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380894:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380899:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380905:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380911:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380917:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380932:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380938:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380944:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380949:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380954:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380959:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380965:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380970:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380976:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380982:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380986:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380991:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.380995:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381001:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381006:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381011:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381018:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381038:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381044:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381049:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381054:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381060:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381064:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381069:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381074:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381079:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381084:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381089:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381095:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381100:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381113:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381118:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381123:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381128:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381133:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381138:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381143:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100492.381156:0:15390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790100492.385152:0:15390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100492.385164:0:15390:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790100492.385169:0:15390:0:(genops.c:885:class_export_put()) final put ffff9261b8ed2000/MDS_uuid 00000020:00000080:1.0:1790100492.385173:0:15390:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b8ed2000/MDS_uuid for MDS 00000020:01000000:1.0:1790100492.385179:0:15390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790100492.385300:0:15390:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1790100493.131468:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790100493.770995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790100493.771005:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100493.771008:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790100493.771011:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790100493.771014:0:37:0:(import.c:65:import_set_state_nolock()) ffff926082856000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100493.771022:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 339 00000100:00080000:2.0:1790100493.771052:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790100493.771063:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff926082856000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100493.771097:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c56300 x1877056141018368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100493.771141:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790100493.771144:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790100493.771146:0:37:0:(import.c:65:import_set_state_nolock()) ffff926083162800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100493.771149:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 339 00000100:00080000:2.0:1790100493.771160:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790100493.771165:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff926083162800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100493.771176:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c54380 x1877056141018624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100493.771228:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141018752:0@lo:400:kworker.0 00000400:00000100:2.0:1790100493.771274:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141018752 offset 0 length 224: 4 00000100:00100000:3.0:1790100493.771378:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056141018368:0@lo:38:kworker.0 00000400:00000100:3.0:1790100493.771402:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141018368 offset 0 length 520: 4 00000100:00100000:3.0:1790100493.771418:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056141018624:0@lo:38:kworker.0 00000400:00000100:3.0:1790100493.771431:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141018624 offset 0 length 520: 4 00000100:00100000:3.0:1790100493.771451:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100493.771457:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056141018496:0@lo:400:kworker.0 00000400:00000100:3.0:1790100493.771472:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141018496 offset 0 length 224: 4 00010000:00010000:3.0:1790100494.155838:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100495.176997:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100496.207274:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790100496.778453:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790100496.778462:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100496.778465:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790100496.778469:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100496.778523:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790100496.778527:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790100496.778570:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056141019008:0@lo:400:kworker.0 00000400:00000100:1.0:1790100496.778633:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141019008 offset 0 length 224: 4 00000100:00100000:3.0:1790100496.778878:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100496.778889:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141018880:0@lo:400:kworker.0 00000400:00000100:3.0:1790100496.778938:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141018880 offset 0 length 224: 4 00000020:01000004:2.0:1790100496.984144:0:15591:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790100497.005574:0:15591:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790100497.005624:0:15591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100497.005725:0:15591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100497.005733:0:15591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100497.005740:0:15591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100497.005769:0:15591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790100497.005774:0:15591:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790100497.005796:0:15591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790100497.005807:0:15591:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c56300 x1877056141018368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790100513 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100497.005830:0:15591:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790100497.005836:0:15591:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790100497.005842:0:15591:0:(import.c:65:import_set_state_nolock()) ffff926082856000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790100497.005846:0:15591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790100497.005850:0:15591:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c56300 x1877056141018368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790100513 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100497.005857:0:15591:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790100497.005860:0:15591:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00010000:00010000:3.0:1790100497.005987:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100497.005994:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100497.006002:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927c00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100497.006005:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100497.006014:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100497.006021:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100497.006027:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790100497.006029:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790100497.006032:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790100497.006044:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:3.0:1790100497.006048:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100497.006054:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298286bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286bb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100497.006065:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100497.006066:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100497.006068:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100497.006150:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056141018368:0@lo:38:kworker.0 00000100:00080000:2.0:1790100497.009238:0:15591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790100497.009254:0:15591:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c54a80 x1877056141018496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100509 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100497.009318:0:15591:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926084c11180 x1877056141018880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100497.009367:0:15591:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790100497.009374:0:15591:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790100497.009409:0:15591:0:(import.c:65:import_set_state_nolock()) ffff926082852000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790100497.010958:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141018880:0@lo:400:kworker.0 00000100:00100000:0.0:1790100497.011053:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1877056141019136:0@lo:39:umount.0 00000400:00000100:0.0:1790100497.011103:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141019136 offset 0 length 224: 4 00000100:00100000:1.0:1790100497.012775:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056141018496:0@lo:400:kworker.0 00010000:00010000:3.0:1790100497.226041:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790100497.870796:0:9503:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790100497.870805:0:9503:0:(genops.c:885:class_export_put()) final put ffff9261bf972800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790100497.870936:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9261bf972800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790100497.870987:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261bf975800 for lustre-OST0001 00000001:00100000:0.0:1790100497.871794:0:8420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790100497.871799:0:8420:0:(genops.c:885:class_export_put()) final put ffff9261a613e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790100497.871927:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a613e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790100497.871969:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261a613b800 for lustre-OST0000 00010000:00010000:2.0:1790100498.251225:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790100498.824447:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790100498.824457:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100498.824476:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790100498.824479:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790100498.824590:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100498.837367:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056141019264:0@lo:400:kworker.0 00000400:00000100:3.0:1790100498.837428:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141019264 offset 0 length 224: 4 00010000:00010000:3.0:1790100499.272626:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100500.296635:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100501.327852:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100502.153014:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100492/real 1790100492] req@ffff926083c56d80 x1877056141018240/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790100502 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100502.153048:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff926083c56d80 x1877056141018240/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790100502 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790100502.153069:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261862ca000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100502.153099:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790100502.153103:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a237a43-d248-40fc-b145-fd7f23146511:3640:1877056141018240:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1790100502.156010:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790100502.156021:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1790100502.156025:0:37:0:(import.c:65:import_set_state_nolock()) ffff9261862ca000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100502.156045:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 343 00000100:00080000:2.0:1790100502.156051:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790100502.156063:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff9261862ca000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100502.156102:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c54000 x1877056141019392/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100502.156131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790100502.156136:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790100502.156205:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100502.156424:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a237a43-d248-40fc-b145-fd7f23146511:3640:1877056141019392:0@lo:250:kworker.0 00000400:00000100:0.0:1790100502.156467:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877056141019392 offset 0 length 520: 4 00000100:00100000:1.0:1790100502.165048:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141019520:0@lo:400:kworker.0 00000400:00000100:1.0:1790100502.166853:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141019520 offset 0 length 224: 4 00010000:00010000:3.0:1790100502.346452:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100503.368535:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100504.395434:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100505.416515:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100506.440844:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100507.272517:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100497/real 1790100497] req@ffff926083c55f80 x1877056141019136/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790100507 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100507.272549:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff926083c55f80 x1877056141019136/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790100507 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790100507.272568:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926082852000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790100507.272592:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1877056141019136:0@lo:39:umount.0 00000100:00080000:2.0:1790100507.273026:0:15591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790100507.273031:0:15591:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790100507.273036:0:15591:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790100507.273984:0:15591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100507.273998:0:15591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100507.274006:0:15591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100507.274013:0:15591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100507.274042:0:15591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100507.274049:0:15591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100507.274056:0:15591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100507.274075:0:15591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100507.274081:0:15591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100507.274103:0:15591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790100507.274107:0:15591:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790100507.274131:0:15591:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790100507.274135:0:15591:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1790100507.274139:0:15591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100507.274144:0:15591:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790100507.274148:0:15591:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9261b7974d40) has no exports 00000020:00080000:2.0:1790100507.274170:0:15591:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9261b7974d40) has no exports 00000020:01000000:2.0:1790100507.275831:0:15591:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff926082387b40 - data ffff92619e29ed80/ffff9261a62c5c00 00010000:00010000:0.0:1790100507.276424:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100507.276433:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100507.276444:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e58200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100507.276447:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100507.276467:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100507.276476:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100507.276481:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790100507.276483:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1790100507.276486:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1790100507.276501:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:0.0:1790100507.276505:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100507.276512:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e58200/0xc87a4f2298286bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286bc6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100507.276523:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100507.276527:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100507.276549:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100507.276552:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100507.276559:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100507.276564:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100507.276569:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790100507.276571:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790100507.276573:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790100507.276580:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:0.0:1790100507.276583:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100507.276589:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298286e12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286e19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100507.276609:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100507.276611:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100507.276613:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100507.276719:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790100507.279784:0:15591:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9261c1a715a0 - data ffff92619e2cad80/ffff9261a6290400 00100000:10000000:2.0:1790100507.292628:0:15591:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790100507.301927:0:15591:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982868e7 00000020:00000080:3.0:1790100507.301938:0:15591:0:(genops.c:885:class_export_put()) final put ffff9260821ba800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1790100507.301957:0:15591:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261b6950800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1790100507.301961:0:15591:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b6950800 2 00000020:01000004:3.0:1790100507.301963:0:15591:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9261b6950800 from lustre-OST0000 00000020:00000080:3.0:1790100507.301986:0:15591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100507.301995:0:15591:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1790100507.301998:0:15591:0:(genops.c:885:class_export_put()) final put ffff9260821bc800/lustre-OST0000_UUID 00000020:00000080:3.0:1790100507.302011:0:15591:0:(genops.c:844:class_export_destroy()) destroying export ffff9260821bc800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1790100507.302018:0:15591:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:1.0:1790100507.302124:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9260821ba800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1790100507.304519:0:15591:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1790100507.304529:0:15591:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790100507.304536:0:15591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790100507.304544:0:15591:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790100507.304552:0:15591:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff926082851000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790100507.304559:0:15591:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9261b7673380) has exports, disconnecting them 00000020:00080000:3.0:1790100507.304564:0:15591:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff926082851000), last request at 1790100310 00000020:00000080:3.0:1790100507.304569:0:15591:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286911 00000020:00080000:3.0:1790100507.307352:0:15591:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff926082851000): rc 0 00000020:00000080:3.0:1790100507.307363:0:15591:0:(genops.c:885:class_export_put()) final put ffff926082851000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790100507.308243:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926082851000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1790100507.327717:0:15591:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790100507.327725:0:15591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790100507.327729:0:15591:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790100507.327736:0:15591:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790100507.327840:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926082856000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790100507.327916:0:15591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100507.327924:0:15591:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1790100507.327929:0:15591:0:(genops.c:885:class_export_put()) final put ffff9261a644e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1790100507.327933:0:15591:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a644e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1790100507.327942:0:15591:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1790100507.327996:0:15591:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790100507.327999:0:15591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100507.328011:0:15591:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790100507.328017:0:15591:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff926082854000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790100507.328024:0:15591:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff926082960000) has exports, disconnecting them 00000020:00080000:2.0:1790100507.328028:0:15591:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff926082854000), last request at 1790100310 00000020:00000080:2.0:1790100507.328032:0:15591:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286926 00000020:00080000:2.0:1790100507.328043:0:15591:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff926082854000): rc 0 00000020:00000080:2.0:1790100507.328046:0:15591:0:(genops.c:885:class_export_put()) final put ffff926082854000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790100507.328327:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff926082854000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1790100507.328678:0:15591:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790100507.328681:0:15591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790100507.328683:0:15591:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790100507.328688:0:15591:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790100507.328727:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926082852000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1790100507.328818:0:15591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100507.328823:0:15591:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1790100507.328825:0:15591:0:(genops.c:885:class_export_put()) final put ffff926082851800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1790100507.328828:0:15591:0:(genops.c:844:class_export_destroy()) destroying export ffff926082851800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1790100507.328831:0:15591:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1790100507.328859:0:15591:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b6950800 1 00000020:00000080:2.0:1790100507.328863:0:15591:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982868af 00000020:00000080:2.0:1790100507.328867:0:15591:0:(genops.c:885:class_export_put()) final put ffff9261a622e000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790100507.328880:0:15591:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790100507.328883:0:15591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100507.328887:0:15591:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790100507.328890:0:15591:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9261b79719c0) has no exports 00000020:00000080:1.0:1790100507.328954:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a622e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790100507.384923:0:15591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100507.384936:0:15591:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790100507.384941:0:15591:0:(genops.c:885:class_export_put()) final put ffff9261b6950000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790100507.384946:0:15591:0:(genops.c:844:class_export_destroy()) destroying export ffff9261b6950000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790100507.384957:0:15591:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790100507.385058:0:15591:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9261b6953800 00000020:02000400:1.0:1790100507.385095:0:15591:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1790100507.464486:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790100507.592510:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790100507.592520:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100507.592523:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790100507.592526:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790100507.592637:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100507.592659:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141019648:0@lo:400:kworker.0 00000400:00000100:3.0:1790100507.592712:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141019648 offset 0 length 224: 4 00010000:00010000:3.0:1790100508.488645:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100509.519038:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1790100509.641411:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100493/real 1790100493] req@ffff926083c56a00 x1877056141018752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790100509 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100509.661279:0:3643:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff926083c56a00 x1877056141018752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790100509 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790100509.661295:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9261bcab8000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790100509.661299:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790100509.683807:0:3643:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1790100509.683886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790100509.683891:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a237a43-d248-40fc-b145-fd7f23146511->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100509.683894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790100509.683897:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100509.683899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790100509.683910:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790100509.683913:0:37:0:(import.c:65:import_set_state_nolock()) ffff9261bcab8000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100509.683921:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 175 00000100:00080000:2.0:1790100509.683934:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9261bcab8000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100509.683971:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c54a80 x1877056141019776/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100509.684021:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141018752:0@lo:400:kworker.0 00000100:00100000:3.0:1790100509.684728:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1877056141019776:0@lo:38:kworker.0 00000400:00000100:3.0:1790100509.684788:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056141019776 offset 0 length 520: 4 00010000:00010000:2.0:1790100510.537991:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790100511.066283:0:15793:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790100511.086279:0:15793:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790100511.086401:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.086417:0:15793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.086424:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.086431:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.086453:0:15793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790100511.086459:0:15793:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790100511.086486:0:15793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790100511.086498:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c54380 x1877056141018624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790100513 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.086516:0:15793:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790100511.086523:0:15793:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790100511.086529:0:15793:0:(import.c:65:import_set_state_nolock()) ffff926083162800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790100511.086533:0:15793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790100511.086537:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c54380 x1877056141018624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790100513 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.086544:0:15793:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790100511.086547:0:15793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:1.0:1790100511.086645:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100511.086653:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100511.086677:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a2e59800 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100511.086680:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100511.086689:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100511.086697:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100511.086702:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790100511.086705:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790100511.086707:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790100511.086719:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:1.0:1790100511.086723:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100511.086730:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a2e59800/0xc87a4f2298286b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286b8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100511.086742:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100511.086744:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100511.086746:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100511.086900:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056141018624:0@lo:38:kworker.0 00000100:00080000:3.0:1790100511.089436:0:15793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790100511.089463:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926084c10000 x1877056141019008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089486:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926084c11500 x1877056141019264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100514 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089494:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c56d80 x1877056141019520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100518 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089514:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926084c13800 x1877056141019648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100523 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089526:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c54a80 x1877056141019776/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790100519 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089539:0:15793:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790100511.089576:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261bcab8000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790100511.089580:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1790100511.089584:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1877056141019776:0@lo:38:kworker.0 00000100:00080000:3.0:1790100511.089608:0:15793:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790100511.089613:0:15793:0:(import.c:65:import_set_state_nolock()) ffff9261bcab8000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790100511.089619:0:15793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790100511.089622:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926084c10000 x1877056141019008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100512 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089629:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926084c11500 x1877056141019264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100514 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089637:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c56d80 x1877056141019520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100518 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089644:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926084c13800 x1877056141019648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100523 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100511.089650:0:15793:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790100511.089659:0:15793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1790100511.089682:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141019520:0@lo:400:kworker.0 00000100:00100000:2.0:1790100511.089728:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056141019264:0@lo:400:kworker.0 00000100:00100000:2.0:1790100511.089735:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1877056141019008:0@lo:400:kworker.0 00000100:00100000:2.0:1790100511.089760:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1877056141019648:0@lo:400:kworker.0 00010000:00010000:3.0:1790100511.093137:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.093155:0:15793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.093163:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.094865:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.094889:0:15793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100511.094899:0:15793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.094906:0:15793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.094918:0:15793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.094923:0:15793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100511.094936:0:15793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790100511.094940:0:15793:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790100511.094975:0:15793:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790100511.094978:0:15793:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790100511.094983:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790100511.095012:0:15793:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1790100511.095015:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:3.0:1790100511.095017:0:15793:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff92608323cd40) has no exports 00010000:00010000:0.0:1790100511.095027:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100511.095037:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c400 already unused, calling callback (ffffffffc13ccc20) 00000020:00080000:3.0:1790100511.095044:0:15793:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff92608323cd40) has no exports 10000000:00010000:0.0:1790100511.095049:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100511.095069:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100511.095078:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100511.095084:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790100511.095087:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1790100511.095090:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1790100511.095102:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:0.0:1790100511.095107:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100511.095116:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298286b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286b9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100511.095129:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100511.095132:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100511.095138:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47c00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100511.095141:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100511.095148:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100511.095155:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100511.095167:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790100511.095169:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790100511.095171:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790100511.095176:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:0.0:1790100511.095179:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100511.095186:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083e47c00/0xc87a4f2298286e04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286e0b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100511.095198:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100511.095200:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100511.095202:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100511.102098:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790100511.103089:0:15793:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff926082387de0 - data ffff92619e287870/ffff92608328a400 00000020:01000000:3.0:1790100511.103609:0:15793:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92608389f180 - data ffff92619e3451b0/ffff926083b98000 00100000:10000000:0.0:1790100511.121049:0:15793:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790100511.129486:0:15793:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a0d 00000020:00000080:1.0:1790100511.129499:0:15793:0:(genops.c:885:class_export_put()) final put ffff9261bcabf000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790100511.129679:0:15793:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261a6449800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790100511.129683:0:15793:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261a6449800 2 00000020:01000004:1.0:1790100511.129686:0:15793:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9261a6449800 from lustre-OST0001 00000020:00000080:1.0:1790100511.129715:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100511.129731:0:15793:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790100511.129733:0:15793:0:(genops.c:885:class_export_put()) final put ffff9261a62f7000/lustre-OST0001_UUID 00000020:00000080:1.0:1790100511.129736:0:15793:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a62f7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790100511.129742:0:15793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790100511.129861:0:15793:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2a237a43-d248-40fc-b145-fd7f23146511->MGS 00010000:00010000:1.0:1790100511.129876:0:15793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261c2179a00/0xc87a4f2298286766 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f229828676d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100511.129952:0:15793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261c2179a00/0xc87a4f2298286766 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f229828676d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100511.129958:0:15793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790100511.129961:0:15793:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790100511.129964:0:15793:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790100511.129976:0:15793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:1.0:1790100511.129979:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261c2179a00/0xc87a4f2298286766 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f229828676d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100511.129996:0:15793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc87a4f2298286c36 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100511.130003:0:15793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc87a4f2298286c36 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100511.130008:0:15793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790100511.130011:0:15793:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790100511.130012:0:15793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790100511.130027:0:15793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9261862ca000 00010000:00010000:1.0:1790100511.130030:0:15793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926083e47000/0xc87a4f2298286c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc87a4f2298286c36 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790100511.130045:0:15793:0:(import.c:65:import_set_state_nolock()) ffff9261862ca000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790100511.130056:0:15793:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790100511.130058:0:15793:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790100511.130059:0:15793:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790100511.130063:0:15793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790100511.130074:0:15793:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff926083c54000 x1877056141019392/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790100517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790100511.130088:0:15793:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790100511.130091:0:15793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:2.0:1790100511.130160:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261bcabf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1790100511.130237:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a237a43-d248-40fc-b145-fd7f23146511:3640:1877056141019392:0@lo:250:kworker.0 10000000:01000000:2.0:1790100511.130315:0:15793:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790100511.130324:0:15793:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286663 00000020:00000080:2.0:1790100511.130329:0:15793:0:(genops.c:885:class_export_put()) final put ffff926184c04000/2a237a43-d248-40fc-b145-fd7f23146511 00000020:01000000:2.0:1790100511.130363:0:15793:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.113@tcp (flags='') 00000020:00000080:2.0:1790100511.130372:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926184c04000/2a237a43-d248-40fc-b145-fd7f23146511 for MGC192.168.203.113@tcp 00000020:00000080:2.0:1790100511.130389:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100511.130393:0:15793:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.113@tcp: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790100511.130396:0:15793:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9261b2304d40) has no exports 10000000:01000000:2.0:1790100511.133392:0:6510:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1790100511.133827:0:15793:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.113@tcp: client import never connected 00000100:00080000:3.0:1790100511.133832:0:15793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1790100511.133835:0:15793:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790100511.133838:0:15793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1790100511.133840:0:15793:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790100511.133889:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100511.133896:0:15793:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.113@tcp (uuid 2a237a43-d248-40fc-b145-fd7f23146511) 00000020:01000000:3.0:1790100511.133902:0:15793:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1790100511.133907:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790100511.133911:0:15793:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790100511.133917:0:15793:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9261a613f800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790100511.133923:0:15793:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff926082964d40) has exports, disconnecting them 00000020:00080000:3.0:1790100511.133928:0:15793:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9261a613f800), last request at 1790100324 00000020:00000080:3.0:1790100511.133933:0:15793:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a37 00000020:00080000:3.0:1790100511.133943:0:15793:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9261a613f800): rc 0 00000020:00000080:3.0:1790100511.133947:0:15793:0:(genops.c:885:class_export_put()) final put ffff9261a613f800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790100511.134648:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261862ca000 for MGC192.168.203.113@tcp 00000020:00000080:2.0:1790100511.134656:0:37:0:(genops.c:885:class_export_put()) final put ffff926187005800/2a237a43-d248-40fc-b145-fd7f23146511 00000020:00000080:2.0:1790100511.134668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926187005800/2a237a43-d248-40fc-b145-fd7f23146511 for MGC192.168.203.113@tcp 00000020:01000000:2.0:1790100511.134674:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.113@tcp (2a237a43-d248-40fc-b145-fd7f23146511) 00000020:00000080:2.0:1790100511.134929:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a613f800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790100511.137388:0:15793:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790100511.137395:0:15793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790100511.137399:0:15793:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790100511.137406:0:15793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790100511.137505:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff926083162800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790100511.137589:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100511.137596:0:15793:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790100511.137601:0:15793:0:(genops.c:885:class_export_put()) final put ffff926083166800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790100511.137604:0:15793:0:(genops.c:844:class_export_destroy()) destroying export ffff926083166800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790100511.137609:0:15793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1790100511.137658:0:15793:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790100511.137662:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100511.137666:0:15793:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790100511.137672:0:15793:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff926083b40000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790100511.137677:0:15793:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff92608323b380) has exports, disconnecting them 00000020:00080000:2.0:1790100511.137681:0:15793:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff926083b40000), last request at 1790100324 00000020:00000080:2.0:1790100511.137684:0:15793:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f2298286a4c 00000020:00080000:2.0:1790100511.137709:0:15793:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff926083b40000): rc 0 00000020:00000080:2.0:1790100511.137712:0:15793:0:(genops.c:885:class_export_put()) final put ffff926083b40000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1790100511.138520:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff926083b40000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1790100511.145436:0:15793:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790100511.145445:0:15793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790100511.145449:0:15793:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790100511.145456:0:15793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790100511.145534:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1790100511.145647:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9261bcab8000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1790100511.145832:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1790100511.145945:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1790100511.146146:0:6496:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff92619229bc00:6496] 0 exiting: rc = 1 00000100:00100000:1.0:1790100511.146231:0:8441:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff926082116e00:8441] 2 exiting: rc = 0 00000100:00100000:2.0:1790100511.146659:0:6497:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9261842d1800:6497] 1 exiting: rc = 0 00000100:00100000:3.0:1790100511.146915:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.147314:0:6499:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff926185504000:6499] 1 exiting: rc = 0 00000100:00100000:2.0:1790100511.147383:0:6498:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff92619229b400:6498] 0 exiting: rc = 1 00000100:00100000:1.0:1790100511.147500:0:9513:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff926083281c00:9513] 3 exiting: rc = 0 00000100:00100000:3.0:1790100511.147600:0:6500:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff92619425a800:6500] 2 exiting: rc = 0 00000100:00100000:3.0:1790100511.147653:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147660:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147667:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147673:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147679:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147685:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147690:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147782:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147793:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147799:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147804:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147810:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147815:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147821:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147827:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147832:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147838:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147843:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147849:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147855:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147861:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147866:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147871:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147876:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147882:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147887:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147892:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147898:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147903:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147908:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147914:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147919:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147924:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147929:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147934:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147945:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147950:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147955:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147960:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147965:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147971:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147975:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147981:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147986:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147992:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.147996:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148001:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148006:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148011:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148016:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148022:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148178:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148187:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148192:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148197:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148202:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148207:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148212:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148218:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148223:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148228:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148233:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148239:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.148244:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790100511.149161:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100511.149170:0:15793:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1790100511.149176:0:15793:0:(genops.c:885:class_export_put()) final put ffff9261a613a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1790100511.149180:0:15793:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a613a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1790100511.149185:0:15793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1790100511.149234:0:15793:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261a6449800 1 00000020:00000080:3.0:1790100511.149239:0:15793:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc87a4f22982869dc 00000020:00000080:3.0:1790100511.149244:0:15793:0:(genops.c:885:class_export_put()) final put ffff9261a62f8800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790100511.149259:0:15793:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790100511.149263:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790100511.149267:0:15793:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790100511.149271:0:15793:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9260829619c0) has no exports 00000020:00000080:1.0:1790100511.150827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a62f8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790100511.219949:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100511.219963:0:15793:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790100511.219969:0:15793:0:(genops.c:885:class_export_put()) final put ffff9261a644f800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790100511.219974:0:15793:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a644f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790100511.219995:0:15793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1790100511.220285:0:15793:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9261a644b800 00000020:01000000:2.0:1790100511.220311:0:15793:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1790100511.220315:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100511.220319:0:15793:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790100511.220323:0:15793:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9261b5ab19c0) has no exports 00000020:00000080:2.0:1790100511.220422:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100511.220428:0:15793:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1790100511.220430:0:15793:0:(genops.c:885:class_export_put()) final put ffff9261a6229000/OSS_uuid 00000020:00000080:2.0:1790100511.220432:0:15793:0:(genops.c:844:class_export_destroy()) destroying export ffff9261a6229000/OSS_uuid for OSS 00000020:01000000:2.0:1790100511.220436:0:15793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1790100511.220597:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1790100511.220633:0:8425:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9261b5b37000:8425] 0 exiting: rc = 1 00000100:00100000:3.0:1790100511.220661:0:10090:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9261a6321e00:10090] 3 exiting: rc = 0 00000100:00100000:2.0:1790100511.221430:0:8426:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9261a612c800:8426] 1 exiting: rc = 0 00000100:00100000:1.0:1790100511.225811:0:8427:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9261c1951800:8427] 2 exiting: rc = 0 00000100:00100000:3.0:1790100511.226000:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226015:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226026:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226033:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226040:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226045:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226050:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226081:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226088:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226092:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226098:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226103:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226108:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226113:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226118:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226125:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226130:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226135:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226140:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226145:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226150:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226155:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226160:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226166:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226171:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226176:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226194:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226199:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226204:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226209:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226214:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226219:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226223:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226228:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226233:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226238:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226243:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226248:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226253:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226258:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226263:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226268:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226274:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226279:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226284:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226290:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226295:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226300:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226305:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226311:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226316:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226321:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226326:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226331:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226336:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226373:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226378:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226384:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226389:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226394:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226399:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226412:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226418:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.226423:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100511.227166:0:8428:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9261c1b2d000:8428] 0 exiting: rc = 1 00000100:00100000:2.0:1790100511.227288:0:12048:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff926082bdc200:12048] 2 exiting: rc = 0 00000100:00100000:0.0:1790100511.229778:0:8429:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9261c1b2d200:8429] 1 exiting: rc = 0 00000100:00100000:3.0:1790100511.229970:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.229978:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.229984:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.229989:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.229994:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.229999:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230003:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230009:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230015:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230019:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230024:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230030:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230035:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230040:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230045:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230050:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230055:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230059:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230064:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230069:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230075:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230079:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230085:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230091:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230096:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230101:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230106:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230111:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230116:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230122:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230128:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230132:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230148:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230153:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230159:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230164:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230169:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230174:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230179:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230184:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230189:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230194:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230200:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230205:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230210:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230215:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230220:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230224:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230229:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230234:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230238:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230243:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230248:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230252:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230257:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230263:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230268:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230274:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230285:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230291:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230297:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230302:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230307:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790100511.230316:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.238825:0:8430:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9261a6119600:8430] 0 exiting: rc = 1 00000100:00100000:1.0:1790100511.239056:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9261a6119c00:8432] 2 exiting: rc = 0 00000100:00100000:3.0:1790100511.241135:0:8431:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9261a6118200:8431] 1 exiting: rc = 0 00000100:00100000:2.0:1790100511.241369:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241383:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241389:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241394:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241400:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241416:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241422:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241427:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241432:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241437:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241442:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241447:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241453:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241458:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241464:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241468:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241473:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241480:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241486:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241491:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241509:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241515:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241520:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241526:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241531:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241537:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241543:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241548:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241554:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241589:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241596:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241602:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241608:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241615:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241620:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241625:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241631:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241638:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241643:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241649:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241655:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241661:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241666:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241672:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.241678:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242048:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242057:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242062:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242068:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242074:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242080:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242085:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242091:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242106:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242113:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242130:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242149:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242155:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242160:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242165:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242171:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242176:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242181:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.242187:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100511.245992:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9261a6119000:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1790100511.246122:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9261a612ce00:8434] 1 exiting: rc = 0 00000100:00100000:2.0:1790100511.246225:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246233:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246238:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246244:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246249:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246254:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246259:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246265:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246270:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246275:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246280:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246285:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246291:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246296:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246301:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246306:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246312:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246317:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246322:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246328:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246334:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246367:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246376:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246382:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246388:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246393:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246414:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246419:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246425:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246431:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246436:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246441:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246447:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246452:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246458:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246463:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246469:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246475:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246480:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246485:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246491:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246496:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246502:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246508:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246512:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246518:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246523:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246528:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246533:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246538:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246543:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246549:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246554:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246560:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246579:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246585:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246590:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246595:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246600:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246606:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246611:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246625:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246630:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.246640:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100511.247721:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9261b7799a00:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1790100511.247981:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9261b7799200:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1790100511.248056:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248086:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248093:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248099:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248104:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248109:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248115:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248120:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248126:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248132:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248137:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248142:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248148:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248168:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248175:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248181:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248187:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248192:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248198:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248205:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248210:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248216:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248221:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248227:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248234:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248254:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248261:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248267:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248272:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248277:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248282:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248287:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248298:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248304:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248310:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248316:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248321:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248359:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248367:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248372:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248378:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248383:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248389:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248394:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248399:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248405:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248411:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248416:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248421:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248441:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248448:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248453:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248460:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248465:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248473:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248479:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248484:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248490:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248495:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248501:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248507:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248514:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248520:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100511.248535:0:15793:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1790100511.262075:0:15793:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790100531.470025:0:16559:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790100544.125607:0:17159:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790100544.125614:0:17159:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1790100544.125615:0:17159:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790100544.125715:0:17159:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff926184c6f000 00000020:01000004:1.0:1790100544.125729:0:17159:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790100544.125737:0:17159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790100544.125750:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9261b79f8000) 00000020:00000080:1.0:1790100544.125774:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790100544.228006:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790100544.229359:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790100544.233190:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1790100544.233641:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1790100544.233922:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790100544.240782:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790100544.242428:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790100544.243716:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.243973:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1790100544.244255:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.244790:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.244979:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790100544.245609:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790100544.247661:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1790100544.248274:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.248788:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.248977:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.249581:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1790100544.249824:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1790100544.250115:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.250370:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.250781:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.250960:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790100544.251255:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1790100544.256681:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1790100544.257085:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1790100544.257291:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1790100544.257731:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1790100544.258068:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1790100544.258300:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1790100544.258635:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1790100544.258885:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1790100544.259131:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1790100544.259819:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1790100544.261201:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1790100544.262119:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1790100544.262704:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1790100544.263121:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790100544.264377:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.264701:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.265043:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.265237:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790100544.265584:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790100544.265980:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1790100544.266196:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790100544.266446:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.266737:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.267597:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.268150:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.268384:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.269033:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.269222:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1790100544.269547:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1790100544.271589:0:17159:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790100544.272164:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790100544.272172:0:17159:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790100544.272184:0:17159:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298287c12 00000020:01000004:1.0:1790100544.272192:0:17159:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1790100544.272196:0:17159:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790100544.272201:0:17159:0:(tgt_mount.c:101:server_register_mount()) register mount ffff926184c6f000 from MGS 00000020:01000004:1.0:1790100544.272205:0:17159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790100544.272214:0:17159:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9261b79f99c0) 00000020:00000080:1.0:1790100544.272225:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790100544.272394:0:17159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff926184c6f000 from MGS, refs=2 00080000:01000000:1.0:1790100544.272400:0:17159:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790100544.272405:0:17159:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298287c20 00000100:00100000:1.0:1790100544.272524:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790100544.272671:0:17159:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790100544.272677:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790100544.273632:0:17159:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790100544.273641:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790100544.275624:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100544.276061:0:17159:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790100544.276067:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790100544.277186:0:17159:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790100544.277197:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790100544.277967:0:17159:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790100544.277974:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790100544.279176:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100544.279180:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100544.279182:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100544.279722:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100544.279724:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100544.279726:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100544.281028:0:17159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790100544.283281:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790100544.290972:0:17159:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1790100544.302020:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790100544.302121:0:17159:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790100544.302179:0:17159:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790100544.303565:0:17159:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790100544.304261:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100544.306104:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790100544.306113:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790100544.308206:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790100544.308218:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790100544.308725:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790100544.308733:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790100544.310280:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790100544.310300:0:17159:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:1.0:1790100544.310302:0:17159:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790100544.310363:0:17159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:1.0:1790100544.310375:0:17159:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (ffff9261b79fcd40) 00000020:00000080:1.0:1790100544.310392:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790100544.310465:0:17159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261b2352000@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790100544.310609:0:17159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:1.0:1790100544.310615:0:17159:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:2.0:1790100544.311394:0:17176:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1790100544.312041:0:17177:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790100544.312121:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 687676b7-da9e-40a3-8051-3299bac6cf99) 00000020:00000080:2.0:1790100544.312141:0:17159:0:(genops.c:1384:class_connect()) connect: client 687676b7-da9e-40a3-8051-3299bac6cf99, cookie 0xc87a4f2298287c2e 00000100:00080000:2.0:1790100544.312150:0:17159:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790100544.312160:0:17159:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff9261b2352000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100544.312192:0:17159:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c57b80 x1877056141019904/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100544.312223:0:17159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 687676b7-da9e-40a3-8051-3299bac6cf99->MGS 00000020:01000004:2.0:1790100544.312241:0:17159:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790100544.312322:0:17159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790100544.312362:0:17159:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff926083238000) 00000020:00000080:2.0:1790100544.312373:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1790100544.313400:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:687676b7-da9e-40a3-8051-3299bac6cf99:3640:1877056141019904:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790100544.313475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100544.313556:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141019904 00000100:00100000:1.0:1790100544.313563:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141019904 00000100:00100000:1.0:1790100544.313594:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100544.313601:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1877056141019904:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1790100544.313625:0:17173:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 687676b7-da9e-40a3-8051-3299bac6cf99@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:1.0:1790100544.313653:0:17173:0:(genops.c:1384:class_connect()) connect: client 687676b7-da9e-40a3-8051-3299bac6cf99, cookie 0xc87a4f2298287c3c 00000100:00080000:1.0:1790100544.313773:0:17173:0:(import.c:65:import_set_state_nolock()) ffff9261b2355000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100544.313829:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+5:3640:x1877056141019904:12345-0@lo:250:mount.lustre.0 Request processed in 227us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100544.313847:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100544.316014:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790100544.316029:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:1.0:1790100544.316037:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790100544.316042:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790100544.316046:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2352000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790100544.316049:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790100544.316064:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790100544.316071:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:687676b7-da9e-40a3-8051-3299bac6cf99:3640:1877056141019904:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790100544.337334:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100544.337559:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790100544.337566:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790100544.343414:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790100544.343426:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790100544.344163:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790100544.344170:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790100544.345183:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100544.345426:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790100544.345431:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790100544.347653:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790100544.347663:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790100544.387237:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100544.387607:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790100544.387614:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790100544.389187:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790100544.389199:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790100544.390069:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100544.390224:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790100544.390229:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790100544.391336:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790100544.391449:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790100544.392148:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100544.392321:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790100544.392336:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790100544.393204:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790100544.393213:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790100544.399998:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100544.400172:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790100544.400179:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790100544.401036:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790100544.401043:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790100544.420080:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100544.420431:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790100544.420438:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790100544.422148:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790100544.422161:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790100544.423250:0:17159:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790100544.423320:0:17159:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790100544.424419:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790100544.424443:0:17159:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790100544.424455:0:17159:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790100544.424549:0:17159:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100544.424581:0:17159:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790100544.424585:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100544.424587:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790100544.424588:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100544.424589:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100544.424590:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100544.424592:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100544.424593:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100544.424594:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790100544.424595:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100544.424597:0:17159:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100544.424599:0:17159:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790100544.424601:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100544.424602:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790100544.424603:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100544.424604:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100544.424605:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100544.424606:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100544.424607:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100544.424608:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790100544.424609:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100544.424610:0:17159:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100544.424635:0:17159:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790100544.424654:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790100544.424725:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.425037:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a22e4900 going to sleep for 11 seconds 00000100:00100000:3.0:1790100544.425153:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141020032 00000100:00100000:3.0:1790100544.425160:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141020032 00000100:00100000:3.0:1790100544.425234:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100544.425244:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+5:17159:x1877056141020032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790100544.427997:0:17175:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790100544.428003:0:17175:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790100544.428007:0:17175:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790100544.428686:0:17196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790100544.429513:0:17175:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1790100544.431096:0:17197:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790100544.431102:0:17197:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790100544.431105:0:17197:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790100544.431108:0:17197:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790100544.431318:0:17197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1790100544.431591:0:17175:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790100544.431601:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790100544.434043:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+5:17159:x1877056141020032:12345-0@lo:253:mount.lustre.0 Request processed in 8793us (9310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.434061:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100544.434140:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020032:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790100544.434154:0:17159:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790100544.434158:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790100544.434159:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790100544.434161:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100544.434162:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100544.434163:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100544.434164:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100544.434165:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790100544.434167:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790100544.434168:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100544.434169:0:17159:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790100544.434186:0:17159:0:(tgt_mount.c:101:server_register_mount()) register mount ffff926184c6f000 from lustre-MDT0000 10000000:01000000:1.0:1790100544.434212:0:17159:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790100544.434215:0:17159:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790100544.434219:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9261b79fcd40 10000000:01000000:1.0:1790100544.434222:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100544.434230:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9261b79fcd40 from 1 10000000:01000000:1.0:1790100544.434232:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790100544.434332:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.434469:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.434480:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100544.434509:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100544.434546:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100544.434612:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082abe480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.434660:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141020160 00000100:00100000:2.0:1790100544.434671:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141020160 00000100:00100000:2.0:1790100544.434744:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100544.434762:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+5:17159:x1877056141020160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100544.434773:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100544.434796:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083927200/0xc87a4f2298287c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287c43 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.434819:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083927200/0xc87a4f2298287c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287c43 expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.434829:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083927200/0xc87a4f2298287c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287c43 expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.434836:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927200, rc 0) 00000100:00100000:2.0:1790100544.434928:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+6:17159:x1877056141020160:12345-0@lo:101:mount.lustre.0 Request processed in 176us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.434934:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100544.435175:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100544.435189:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.435198:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100544.435277:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100544.435305:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100544.435551:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100544.435617:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141020288 00000100:00100000:1.0:1790100544.435623:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141020288 00000100:00100000:1.0:1790100544.435646:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100544.435654:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+6:17159:x1877056141020288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100544.435787:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+6:17159:x1877056141020288:12345-0@lo:501:mount.lustre.0 Request processed in 133us (480us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100544.435794:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100544.435959:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020288:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790100544.435985:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790100544.436004:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.436014:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100544.436021:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff926184c6f000 10000000:01000000:3.0:1790100544.436025:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790100544.436029:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff926184c6f000 10000000:01000000:3.0:1790100544.436031:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790100544.436034:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff926184c6f000 from 1 10000000:01000000:3.0:1790100544.436036:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790100544.436055:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6600/0xc87a4f2298287c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.436073:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b6600/0xc87a4f2298287c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.436081:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b6600/0xc87a4f2298287c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100544.436094:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100544.436113:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100544.436128:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.436146:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141020416 00000100:00100000:2.0:1790100544.436150:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141020416 00000100:00100000:2.0:1790100544.436237:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100544.436245:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+6:17159:x1877056141020416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100544.436253:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100544.436264:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926600/0xc87a4f2298287c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287c51 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.436281:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926600/0xc87a4f2298287c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287c51 expref: 7 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.436289:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926600/0xc87a4f2298287c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287c51 expref: 7 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.436303:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926600, rc 0) 00000100:00100000:2.0:1790100544.436371:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+7:17159:x1877056141020416:12345-0@lo:101:mount.lustre.0 Request processed in 127us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.436377:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100544.436450:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100544.436461:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b6600/0xc87a4f2298287c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c58 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.436469:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6600/0xc87a4f2298287c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287c58 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100544.436480:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790100544.436527:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6600/0xc87a4f2298287c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c58 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.436536:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b6600/0xc87a4f2298287c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c58 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100544.436541:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790100544.436544:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790100544.436548:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff926184c6f000 10000000:01000000:3.0:1790100544.436551:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790100544.436559:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790100544.436561:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790100544.436575:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298287c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.436582:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298287c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.436589:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298287c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100544.436600:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100544.436625:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100544.436654:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100544.436718:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141020544 00000100:00100000:1.0:1790100544.436722:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141020544 00000100:00100000:1.0:1790100544.436773:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100544.436783:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+7:17159:x1877056141020544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100544.436787:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100544.436793:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926184b8e600/0xc87a4f2298287c66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287c5f expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.436802:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926184b8e600/0xc87a4f2298287c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287c5f expref: 8 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.436807:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926184b8e600/0xc87a4f2298287c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287c5f expref: 8 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.436812:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e600, rc 0) 00000100:00100000:1.0:1790100544.436837:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+8:17159:x1877056141020544:12345-0@lo:101:mount.lustre.0 Request processed in 55us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100544.436847:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100544.437001:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100544.437071:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298287c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c66 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.437079:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298287c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287c66 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100544.437126:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100544.437152:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.437247:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141020672 00000100:00100000:2.0:1790100544.437253:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141020672 00000100:00100000:2.0:1790100544.437282:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790100544.437289:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+8:17159:x1877056141020672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100544.437681:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+9:17159:x1877056141020672:12345-0@lo:501:mount.lustre.0 Request processed in 392us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.437688:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100544.437792:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100544.437805:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100544.437832:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100544.437872:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100544.437898:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083d55000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100544.437989:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141020800 00000100:00100000:1.0:1790100544.437993:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141020800 00000100:00100000:1.0:1790100544.438022:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100544.438029:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+9:17159:x1877056141020800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100544.438743:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+9:17159:x1877056141020800:12345-0@lo:503:mount.lustre.0 Request processed in 713us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100544.438760:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100544.439803:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141020800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100544.440308:0:17198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17198:1877056141020928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100544.440920:0:17198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100544.440988:0:17198:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082abe240 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.441142:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141020928 00000100:00100000:2.0:1790100544.441149:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141020928 00000100:00100000:2.0:1790100544.441240:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100544.441250:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+9:17198:x1877056141020928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100544.442175:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+9:17198:x1877056141020928:12345-0@lo:502:llog_process_th.0 Request processed in 924us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.442184:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100544.442260:0:17198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17198:1877056141020928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100544.442295:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100544.442305:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.442307:0:17198:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790100544.442312:0:17198:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790100544.442315:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100544.442373:0:17198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9261b79fb380) 00000020:00000080:1.0:1790100544.442389:0:17198:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790100544.442716:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790100544.442803:0:17198:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790100544.442810:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298287c74 00000020:00000080:1.0:1790100544.443151:0:17198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790100544.443157:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100544.443160:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.443162:0:17198:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790100544.443164:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100544.443241:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.443243:0:17198:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790100544.443247:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100544.443255:0:17198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9261b2304d40) 00000020:00000080:1.0:1790100544.443266:0:17198:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790100544.443271:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790100544.443273:0:17198:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790100544.443275:0:17198:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790100544.443281:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790100544.443333:0:17198:0:(tgt_mount.c:153:server_get_mount()) get mount ffff926184c6f000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790100544.443673:0:17198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9261b2303380) 00000020:00000080:1.0:1790100544.443684:0:17198:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790100544.443733:0:17198:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790100544.443737:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298287c89 00000020:00000080:1.0:1790100544.443822:0:17198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790100544.443828:0:17198:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790100544.443833:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc87a4f2298287c90 00080000:01000000:1.0:1790100544.443837:0:17198:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790100544.443840:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298287c97 00010000:00010000:3.0:1790100544.549004:0:17198:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790100544.549447:0:17198:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1790100544.550160:0:17198:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790100544.550782:0:17198:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff926082963380) 00000020:00000080:3.0:1790100544.550799:0:17198:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790100544.551105:0:17198:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790100544.551113:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298287ca5 00000020:00000080:2.0:1790100544.553940:0:17198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790100544.560845:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc87a4f2298287cac 00000020:00000080:0.0:1790100544.566441:0:17198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790100544.566454:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100544.566462:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.566464:0:17198:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790100544.566467:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790100544.566469:0:17198:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1790100544.566471:0:17198:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100544.566472:0:17198:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100544.566474:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790100544.566476:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.566478:0:17198:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790100544.566480:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100544.566495:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.566497:0:17198:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790100544.566501:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790100544.566560:0:17198:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790100544.566577:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100544.566580:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.566594:0:17198:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790100544.566597:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100544.566601:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.566602:0:17198:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1790100544.566622:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790100544.566627:0:17198:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:00000080:0.0:1790100544.566652:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100544.566668:0:17198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9261b7970000) 00000020:00000080:0.0:1790100544.566682:0:17198:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790100544.566687:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790100544.566739:0:17198:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1790100544.566744:0:17198:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790100544.566751:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298287cba 00010000:00080000:0.0:1790100544.566781:0:17198:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261a6139800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790100544.569910:0:17198:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1790100544.571501:0:17198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790100544.571514:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790100544.571546:0:17198:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790100544.571564:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298287cc1 00000100:00080000:1.0:1790100544.571574:0:17198:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790100544.572104:0:17198:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9261a6139800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100544.572140:0:17198:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926084c10a80 x1877056141021056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100544.572168:0:17198:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1790100544.572230:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100544.572234:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.572236:0:17198:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790100544.572239:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790100544.572250:0:17198:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1790100544.572252:0:17198:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790100544.572253:0:17198:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790100544.572311:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790100544.572315:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.572317:0:17198:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790100544.572320:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790100544.572409:0:17198:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790100544.572414:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.572415:0:17198:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790100544.572420:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790100544.572423:0:17198:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1790100544.572444:0:17198:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790100544.572447:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100544.572459:0:17198:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9261b2300000) 00000020:00000080:1.0:1790100544.572470:0:17198:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790100544.572475:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790100544.572645:0:17198:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790100544.572652:0:17198:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790100544.572658:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298287ccf 00010000:00080000:1.0:1790100544.572682:0:17198:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261a24c3000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790100544.572887:0:17198:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1790100544.573625:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141021056:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790100544.573688:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100544.573879:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141021056 00000100:00100000:3.0:1790100544.573888:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141021056 00000100:00100000:3.0:1790100544.573924:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100544.573931:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1877056141021056:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1790100544.573945:0:17185:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1790100544.581839:0:17198:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790100544.582248:0:17198:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790100544.591375:0:17198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100544.592902:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790100544.604017:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790100544.611906:0:17204:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790100544.611913:0:17204:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790100544.613645:0:17198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790100544.613658:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100544.613700:0:17198:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790100544.613718:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298287cd6 00000100:00080000:0.0:1790100544.613728:0:17198:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100544.613739:0:17198:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9261a24c3000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100544.613772:0:17198:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6256680 x1877056141021184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100544.613797:0:17198:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790100544.613862:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100544.613866:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.613868:0:17198:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790100544.613871:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790100544.613874:0:17198:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1790100544.613875:0:17198:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100544.613877:0:17198:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100544.613878:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790100544.613880:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.613882:0:17198:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790100544.613884:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100544.613887:0:17198:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790100544.613890:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.613892:0:17198:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790100544.613895:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790100544.613899:0:17198:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:0.0:1790100544.613920:0:17198:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790100544.613923:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100544.613934:0:17198:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9261b79719c0) 00000020:00000080:0.0:1790100544.613945:0:17198:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1790100544.613949:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790100544.614014:0:17198:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790100544.614019:0:17198:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1790100544.614026:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc87a4f2298287ce4 00010000:00080000:0.0:1790100544.614052:0:17198:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261b2023000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790100544.614243:0:17198:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790100544.614329:0:17198:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790100544.614368:0:17198:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1790100544.614816:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141021184:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790100544.614865:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141021184 offset 0 length 520: 4 00000100:00100000:2.0:1790100544.626986:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1877056141021056:12345-0@lo:38:llog_process_th.0 Request processed in 53049us (53292us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100544.627004:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790100544.627939:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790100544.627946:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790100544.627950:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141021056:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790100544.631737:0:17198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100544.632838:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1790100544.633737:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1790100544.637017:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790100544.637024:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790100544.640937:0:17198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790100544.640960:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100544.641002:0:17198:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790100544.641023:0:17198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298287ceb 00000100:00080000:0.0:1790100544.641033:0:17198:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100544.641043:0:17198:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9261b2023000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100544.641079:0:17198:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6254000 x1877056141021312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100544.641112:0:17198:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790100544.641270:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100544.641275:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.641276:0:17198:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790100544.641279:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100544.641283:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.641284:0:17198:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790100544.641287:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790100544.641288:0:17198:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790100544.641290:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100544.641292:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.641293:0:17198:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790100544.641295:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100544.641297:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.641298:0:17198:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790100544.641301:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790100544.641366:0:17198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17198:1877056141021440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100544.641436:0:17198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.641577:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141021312:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790100544.641626:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141021312 offset 0 length 520: 4 00000100:00100000:0.0:1790100544.642638:0:17198:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083dd7180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100544.644616:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141021440 00000100:00100000:0.0:1790100544.644629:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141021440 00000100:00100000:0.0:1790100544.644692:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790100544.644702:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+9:17198:x1877056141021440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100544.644900:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+9:17198:x1877056141021440:12345-0@lo:502:llog_process_th.0 Request processed in 198us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100544.644908:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790100544.644967:0:17198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17198:1877056141021440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100544.644999:0:17198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100544.645006:0:17198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100544.645008:0:17198:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790100544.645013:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1790100544.645135:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1790100544.645153:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790100544.645167:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298287c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c66 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100544.645178:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b6c00/0xc87a4f2298287c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c66 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100544.645186:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926184c6f000 from 1 10000000:01000000:0.0:1790100544.645189:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100544.645217:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100544.645226:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100544.645234:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100544.645252:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141021568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100544.645294:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100544.645310:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083dd7180 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.645522:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141021568 00000100:00100000:2.0:1790100544.645528:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141021568 00000100:00100000:2.0:1790100544.645559:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100544.645567:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+9:17159:x1877056141021568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100544.645576:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100544.645589:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287cf2 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.645610:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.645621:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.645629:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927800, rc 0) 00000100:00100000:2.0:1790100544.645659:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+10:17159:x1877056141021568:12345-0@lo:101:mount.lustre.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.645665:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100544.645930:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141021568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100544.645943:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100544.645952:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100544.647435:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141021696:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790100544.649943:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100544.650030:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083dd7180 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.653992:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141021696 00000100:00100000:2.0:1790100544.654007:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141021696 00000100:00100000:2.0:1790100544.654125:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790100544.654136:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+10:17159:x1877056141021696:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790100544.654161:0:17175:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790100544.654179:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790100544.654309:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+10:17159:x1877056141021696:12345-0@lo:256:mount.lustre.0 Request processed in 175us (4372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.654317:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100544.654527:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141021696:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1790100544.655071:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790100544.655090:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.655100:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100544.655108:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926184c6f000 from 1 10000000:01000000:1.0:1790100544.655110:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100544.655141:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.655149:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.655158:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100544.655176:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141021824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100544.655215:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100544.659673:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261931bf600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.660774:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141021824 00000100:00100000:2.0:1790100544.660784:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141021824 00000100:00100000:2.0:1790100544.660821:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100544.660830:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+10:17159:x1877056141021824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100544.660846:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100544.660875:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287d00 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.660902:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.660913:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.660921:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927a00, rc 0) 00000100:00100000:2.0:1790100544.660977:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+11:17159:x1877056141021824:12345-0@lo:101:mount.lustre.0 Request processed in 148us (5761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.660984:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100544.671902:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141021824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100544.671929:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100544.671942:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100544.672053:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141021952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100544.672145:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100544.672179:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261931bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100544.672444:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141021952 00000100:00100000:0.0:1790100544.672452:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141021952 00000100:00100000:0.0:1790100544.672501:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790100544.672511:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+11:17159:x1877056141021952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100544.672647:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+11:17159:x1877056141021952:12345-0@lo:501:mount.lustre.0 Request processed in 138us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100544.672653:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100544.673456:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141021952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100544.673504:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141022080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100544.673552:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100544.673595:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261931bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100544.674190:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141022080 00000100:00100000:0.0:1790100544.674197:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141022080 00000100:00100000:0.0:1790100544.674228:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790100544.674236:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+11:17159:x1877056141022080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100544.674365:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+11:17159:x1877056141022080:12345-0@lo:503:mount.lustre.0 Request processed in 130us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100544.674372:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790100544.674623:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141022080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100544.675192:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17208:1877056141022208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100544.675234:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100544.675275:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261931bf780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100544.675668:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141022208 00000100:00100000:0.0:1790100544.675674:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141022208 00000100:00100000:0.0:1790100544.675709:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100544.675716:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+11:17208:x1877056141022208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100544.676309:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+11:17208:x1877056141022208:12345-0@lo:502:llog_process_th.0 Request processed in 592us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100544.676317:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100544.683035:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17208:1877056141022208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100544.683083:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100544.683095:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.683097:0:17208:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790100544.683105:0:17208:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff926184c6f000 00000020:00000080:1.0:1790100544.683108:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100544.683119:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100544.683121:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.683122:0:17208:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790100544.683125:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100544.683127:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.683128:0:17208:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790100544.683131:0:17208:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff926184c6f000 00000020:00000080:1.0:1790100544.683133:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100544.683192:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100544.683196:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.683197:0:17208:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790100544.683200:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100544.683210:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.683212:0:17208:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790100544.683216:0:17208:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff926184c6f000 00000020:00000080:1.0:1790100544.683217:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100544.683235:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100544.683237:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.683239:0:17208:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790100544.683241:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100544.683243:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100544.683244:0:17208:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790100544.683247:0:17208:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff926184c6f000 00000020:00000080:1.0:1790100544.683249:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790100544.698239:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17208:1877056141022336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100544.700877:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.700931:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141022336 00000100:00100000:2.0:1790100544.700940:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141022336 00000100:00100000:2.0:1790100544.700987:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790100544.700996:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+11:17208:x1877056141022336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100544.701123:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+11:17208:x1877056141022336:12345-0@lo:502:llog_process_th.0 Request processed in 127us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.701131:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790100544.701189:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.701210:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17208:1877056141022336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100544.701242:0:17208:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100544.701249:0:17208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100544.701251:0:17208:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790100544.701256:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1790100544.701358:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790100544.701379:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790100544.701392:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.701404:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100544.701445:0:17159:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790100544.701448:0:17159:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff926184c6f000 10000000:01000000:2.0:1790100544.701451:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff926184c6f000 10000000:01000000:2.0:1790100544.701454:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790100544.701460:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926184c6f000 from 1 10000000:01000000:2.0:1790100544.701462:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790100544.709156:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298287d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.709177:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298287d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.709208:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298287d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100544.709684:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141022464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790100544.710573:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.710626:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141022464 00000100:00100000:2.0:1790100544.710634:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141022464 00000100:00100000:2.0:1790100544.710681:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790100544.710690:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+11:17159:x1877056141022464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100544.710706:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100544.710722:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926c00/0xc87a4f2298287d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287d0e expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.711063:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926c00/0xc87a4f2298287d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287d0e expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.711079:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926c00/0xc87a4f2298287d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287d0e expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.711087:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926c00, rc 0) 00000100:00100000:2.0:1790100544.711131:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17159:x1877056141022464:12345-0@lo:101:mount.lustre.0 Request processed in 441us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.711137:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790100544.711185:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.711205:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141022464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100544.711220:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298287d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d15 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.711240:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298287d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287d15 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100544.712962:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141022592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100544.713010:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.713036:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.713065:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141022592 00000100:00100000:2.0:1790100544.713071:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141022592 00000100:00100000:2.0:1790100544.713103:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100544.713111:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+12:17159:x1877056141022592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100544.713226:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+12:17159:x1877056141022592:12345-0@lo:501:mount.lustre.0 Request processed in 115us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.713233:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100544.713289:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141022592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100544.713317:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141022720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100544.713381:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.713395:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.713409:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141022720 00000100:00100000:2.0:1790100544.713412:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141022720 00000100:00100000:2.0:1790100544.713434:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100544.713440:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+12:17159:x1877056141022720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100544.714630:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+12:17159:x1877056141022720:12345-0@lo:503:mount.lustre.0 Request processed in 1185us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.714639:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100544.714704:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141022720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100544.718906:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17212:1877056141022848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100544.718981:0:17212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100544.719066:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261830ab900 going to sleep for 11 seconds 00000100:00100000:3.0:1790100544.735819:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141022848 00000100:00100000:3.0:1790100544.735833:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141022848 00000100:00100000:3.0:1790100544.735985:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790100544.735997:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17212:x1877056141022848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100544.736163:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17212:x1877056141022848:12345-0@lo:502:llog_process_th.0 Request processed in 168us (17181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100544.736171:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100544.736477:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17212:1877056141022848:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790100544.736548:0:17212:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790100544.736563:0:17212:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9260832399c0) 00000020:00000080:2.0:1790100544.736582:0:17212:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1790100544.736673:0:17212:0:(tgt_mount.c:153:server_get_mount()) get mount ffff926184c6f000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790100544.736677:0:17212:0:(tgt_mount.c:187:server_put_mount()) put mount ffff926184c6f000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790100544.736679:0:17212:0:(obd_mount.c:710:lustre_put_lsi()) put ffff926184c6f000 4 00010000:00080000:2.0:1790100544.736716:0:17212:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92608490d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790100544.738275:0:17212:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1790100544.738498:0:17212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790100544.738534:0:17212:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790100544.738544:0:17212:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc87a4f2298287d23 00000100:00080000:2.0:1790100544.738553:0:17212:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790100544.738562:0:17212:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff92608490d800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100544.738592:0:17212:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c56300 x1877056141022976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100544.738615:0:17212:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790100544.738667:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056141022976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790100544.738735:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.738864:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141022976 00000100:00100000:2.0:1790100544.738870:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141022976 00000100:00100000:2.0:1790100544.738897:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100544.738903:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1877056141022976:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790100544.738951:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1877056141022976:12345-0@lo:38:llog_process_th.0 Request processed in 46us (216us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790100544.738958:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100544.738996:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790100544.739003:0:3640:0:(import.c:65:import_set_state_nolock()) ffff92608490d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100544.739006:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790100544.739010:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056141022976:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790100544.739843:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790100544.739849:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790100544.739852:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100544.739857:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:1.0:1790100544.739861:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790100544.739868:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9261a6139800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100544.739890:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926084c10a80 x1877056141023104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100544.739909:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100544.739913:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100544.739916:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100544.739919:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790100544.739938:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141023104:0@lo:38:kworker.0 00000100:00100000:1.0:1790100544.739975:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.744381:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141023104 00000100:00100000:2.0:1790100544.744394:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141023104 00000100:00100000:2.0:1790100544.744436:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100544.744444:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877056141023104:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790100544.744464:0:17186:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790100544.746009:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17212:1877056141023232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100544.746089:0:17212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100544.746130:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a22e70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.746883:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877056141023104:12345-0@lo:38:kworker.0 Request processed in 2436us (6904us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100544.746894:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100544.746924:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141023232 00000100:00100000:2.0:1790100544.746930:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141023232 00000100:00100000:2.0:1790100544.746961:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100544.746969:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+12:17212:x1877056141023232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100544.747083:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+12:17212:x1877056141023232:12345-0@lo:502:llog_process_th.0 Request processed in 114us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.747090:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100544.747137:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17212:1877056141023232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100544.747184:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17212:1877056141023360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100544.747217:0:17212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.747240:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b20936c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100544.747251:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141023360 00000100:00100000:2.0:1790100544.747254:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141023360 00000100:00100000:2.0:1790100544.748633:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100544.748641:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+12:17212:x1877056141023360:12345-0@lo:502:llog_process_th.0 00000100:00080000:0.0:1790100544.749180:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100544.749186:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790100544.749190:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141023104:0@lo:38:kworker.0 00000100:00100000:2.0:1790100544.750353:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+12:17212:x1877056141023360:12345-0@lo:502:llog_process_th.0 Request processed in 108us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.750365:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100544.750448:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:687676b7-da9e-40a3-8051-3299bac6cf99:17212:1877056141023360:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790100544.750481:0:17212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790100544.751570:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790100544.751595:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790100544.751614:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298287d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d15 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.751626:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083927c00/0xc87a4f2298287d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d15 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790100544.751680:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790100544.751682:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790100544.751683:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100544.751684:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100544.751685:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100544.751686:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100544.751687:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100544.751689:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100544.751691:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100544.751692:0:17159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790100544.751695:0:17159:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790100544.751698:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790100544.751699:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790100544.751700:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100544.751701:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100544.751702:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100544.751703:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100544.751704:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100544.751705:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100544.751706:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100544.751706:0:17159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790100544.751727:0:17159:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790100544.751743:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141023488:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790100544.751904:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100544.751938:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141023488 00000100:00100000:3.0:1790100544.751944:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141023488 00000100:00100000:3.0:1790100544.751991:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790100544.752006:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17159:x1877056141023488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790100544.752029:0:17173:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790100544.752041:0:17173:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790100544.752158:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a22e7c00 going to sleep for 11 seconds 20000000:01000000:0.0:1790100544.759601:0:17173:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790100544.759615:0:17173:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790100544.759734:0:17196:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790100544.759740:0:17196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790100544.759772:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.759790:0:17196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.759802:0:17196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.759840:0:17196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100544.759854:0:17196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 12 pid: 17175 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100544.759869:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141023616:0@lo:104: 00000100:00100000:3.0:1790100544.759927:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100544.759969:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261a22e70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100544.760085:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141023616 00000100:00100000:0.0:1790100544.760092:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141023616 00000100:00100000:0.0:1790100544.760134:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100544.760152:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:17196:x1877056141023616:12345-0@lo:104: 00010000:00010000:0.0:1790100544.760164:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100544.760218:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100544.760224:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:17196:x1877056141023616:12345-0@lo:104: Request processed in 82us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100544.760231:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100544.760265:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141023616:0@lo:104: 00010000:00010000:0.0:1790100544.760291:0:17196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100544.760830:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17159:x1877056141023488:12345-0@lo:253:mount.lustre.0 Request processed in 8824us (8925us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100544.760838:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790100544.761011:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17159:1877056141023488:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790100544.761022:0:17159:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790100544.761025:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100544.761027:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790100544.761028:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100544.761029:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100544.761563:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100544.761566:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100544.761568:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100544.761569:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790100544.761571:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100544.761572:0:17159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790100544.761586:0:17159:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790100544.761969:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100544.761976:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.761985:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565de00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100544.761990:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.761999:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100544.762006:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100544.762013:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100544.762049:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762055:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100544.762078:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762096:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287cf9 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762110:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100544.762111:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100544.762113:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100544.762146:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141023744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100544.762188:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100544.762283:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141023744 00000100:00100000:2.0:1790100544.762290:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141023744 00010000:00010000:2.0:1790100544.762313:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 12 pid: 17175 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100544.762366:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100544.762374:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:687676b7-da9e-40a3-8051-3299bac6cf99+12:3641:x1877056141023744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100544.762384:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100544.762389:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 12 pid: 17175 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762399:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 12 pid: 17175 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762412:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083927800/0xc87a4f2298287cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287cf2 expref: 12 pid: 17175 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762424:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762442:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790100544.762456:0:17165:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002715710s 00010000:00010000:2.0:1790100544.762461:0:17165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762468:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762475:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762481:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762496:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100544.762500:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762508:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762522:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762532:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100544.762563:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:687676b7-da9e-40a3-8051-3299bac6cf99+11:3641:x1877056141023744:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100544.762570:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790100544.762601:0:17196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762609:0:17196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100544.762615:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d2a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100544.762641:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141023744:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1790100544.816458:0:17159:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1790100544.816838:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790100544.817011:0:17219:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1790100544.817015:0:17219:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1790100544.817130:0:17220:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790100544.817237:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1790100544.817591:0:17220:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100544.821205:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790100544.821284:0:17220:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1790100544.821796:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790100544.821837:0:17159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790100544.822250:0:17159:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790100544.822257:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790100544.822293:0:17159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100544.823239:0:17159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790100544.823807:0:17159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790100544.823841:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:3.0:1790100544.824560:0:17221:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff926083284a80 x1877056141023872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100544.824572:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00080000:10000000:0.0:1790100544.828103:0:17159:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1790100544.830545:0:17159:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1790100544.843613:0:17159:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790100544.843656:0:17159:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbae481773988 00100000:10000000:2.0:1790100544.843664:0:17159:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790100544.844946:0:17159:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790100544.844964:0:17159:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790100544.844981:0:17159:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790100544.845006:0:17159:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790100544.850612:0:17159:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100544.850922:0:17159:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100545.299473:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790100545.416538:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790100545.416546:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926184c6f000 from 7 10000000:01000000:1.0:1790100545.416551:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100545.416609:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100545.416622:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100545.416633:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100545.416657:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141024000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100545.416723:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100545.416788:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2563600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100545.417088:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141024000 00000100:00100000:2.0:1790100545.417096:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141024000 00000100:00100000:2.0:1790100545.417150:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790100545.417159:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+11:17177:x1877056141024000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100545.417172:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100545.417184:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287d31 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100545.417205:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100545.417230:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100545.417238:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927000, rc 0) 00000100:00100000:2.0:1790100545.417298:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+12:17177:x1877056141024000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100545.417304:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100545.417552:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141024000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100545.417568:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100545.417577:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100545.417624:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141024128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790100545.417656:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100545.417677:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b224e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100545.417690:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141024128 00000100:00100000:0.0:1790100545.417693:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141024128 00000100:00100000:0.0:1790100545.417715:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100545.417721:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17177:x1877056141024128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790100545.417734:0:17173:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790100545.417759:0:17173:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790100545.417763:0:17173:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790100545.417846:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17177:x1877056141024128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100545.417861:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100545.417891:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141024128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790100545.417940:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100545.417946:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100545.417953:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100545.808511:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790100545.864483:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:2.0:1790100546.324678:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100546.825127:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790100546.896997:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790100547.340415:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100547.915461:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:2.0:1790100548.361116:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100548.936401:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00000001:02000400:1.0:1790100549.221318:0:17464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790100549.385719:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100549.962989:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00000020:00000004:1.0:1790100550.022722:0:17516:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100550.024598:0:17516:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1790100550.088997:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790100550.089015:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790100550.089019:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100550.089027:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:1.0:1790100550.089033:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790100550.089044:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9261a6139800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100550.089066:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926084c12680 x1877056141024384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100550.089095:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100550.089100:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100550.089103:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100550.089105:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100550.089108:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790100550.089111:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790100550.089112:0:38:0:(import.c:65:import_set_state_nolock()) ffff92608490d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100550.089118:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff92608490d800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100550.089130:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926084c13800 x1877056141024512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100550.089273:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141024384:0@lo:38:kworker.0 00000100:00100000:1.0:1790100550.089366:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100550.089421:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056141024512:0@lo:38:kworker.0 00000100:00100000:1.0:1790100550.089466:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100550.089511:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141024512 00000100:00100000:1.0:1790100550.089519:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141024512 00000100:00100000:1.0:1790100550.089550:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100550.089564:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877056141024512:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790100550.089590:0:17182:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:1.0:1790100550.089624:0:17182:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc87a4f2298287d3f 00000004:00100000:1.0:1790100550.089639:0:17182:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790100550.089771:0:17182:0:(import.c:65:import_set_state_nolock()) ffff926184c04000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100550.089818:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877056141024512:12345-0@lo:38:kworker.0 Request processed in 254us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100550.089825:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100550.089923:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141024256:0@lo:400:kworker.0 00000100:00100000:2.0:1790100550.089958:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100550.090003:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141024256 00000100:00100000:2.0:1790100550.090007:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141024256 00000100:00100000:2.0:1790100550.090035:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100550.090042:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:3642:x1877056141024256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100550.090076:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:3642:x1877056141024256:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100550.090083:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100550.090127:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141024256:0@lo:400:kworker.0 00000100:00100000:2.0:1790100550.090894:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141024384 00000100:00100000:2.0:1790100550.090901:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141024384 00000100:00100000:2.0:1790100550.090929:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100550.090935:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1877056141024384:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790100550.090949:0:17185:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1790100550.091397:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff926084c13800 x1877056141024512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790100550.091414:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790100550.091421:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790100550.091427:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790100550.091430:0:3640:0:(import.c:65:import_set_state_nolock()) ffff92608490d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790100550.091436:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877056141024512:0@lo:38:kworker.0 00000100:00100000:2.0:1790100550.115450:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1877056141024384:12345-0@lo:38:kworker.0 Request processed in 24508us (26077us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100550.115464:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790100550.115556:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790100550.115562:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790100550.115567:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141024384:0@lo:38:kworker.0 00010000:00010000:1.0:1790100550.410610:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790100550.851796:0:17566:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100550.852691:0:17566:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790100550.985468:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790100551.433328:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100552.011845:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790100552.457273:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100553.034417:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790100553.481832:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100554.056440:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00000100:00100000:1.0:1790100554.188545:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100544/real 1790100544] req@ffff9261a6254000 x1877056141021312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100554 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100554.188572:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9261a6254000 x1877056141021312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100554 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100554.188582:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100544/real 1790100544] req@ffff9261a6256680 x1877056141021184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100554 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100554.188593:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9261a6256680 x1877056141021184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100554 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790100554.188613:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2023000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790100554.188628:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790100554.188632:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141021312:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790100554.188648:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a24c3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790100554.188653:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790100554.188656:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141021184:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790100554.192403:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790100554.192490:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790100554.192493:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100554.192500:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:2.0:1790100554.192505:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790100554.192516:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9261a6139800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100554.192540:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c55880 x1877056141024768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100554.192556:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100554.192559:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790100554.192561:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261a24c3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100554.192564:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:2.0:1790100554.192567:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790100554.192570:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9261a24c3000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100554.192579:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c55180 x1877056141024896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100554.192588:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100554.192590:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790100554.192592:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261b2023000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100554.192594:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:2.0:1790100554.192597:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790100554.192611:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9261b2023000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100554.192621:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c56680 x1877056141025024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100554.192676:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056141025152:0@lo:400:kworker.0 00000100:00100000:2.0:1790100554.192792:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100554.192837:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100554.192843:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141024640:0@lo:400:kworker.0 00000100:00100000:2.0:1790100554.192869:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100554.192978:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141025152 00000100:00100000:2.0:1790100554.192987:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141025152 00000100:00100000:2.0:1790100554.193021:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100554.193030:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056141025152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100554.193076:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056141025152:12345-0@lo:400:kworker.0 Request processed in 47us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100554.193083:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790100554.193117:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff926083c55c00 x1877056141025152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100554.193129:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056141025152:0@lo:400:kworker.0 00000100:00100000:1.0:1790100554.194939:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141024768:0@lo:38:kworker.0 00000100:00100000:1.0:1790100554.194994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100554.195022:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141024896:0@lo:8:kworker.0 00000400:00000100:1.0:1790100554.195060:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141024896 offset 0 length 520: 4 00000100:00100000:1.0:1790100554.195082:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141025024:0@lo:8:kworker.0 00000400:00000100:1.0:1790100554.195101:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141025024 offset 0 length 520: 4 00000100:00100000:1.0:1790100554.195128:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141024640 00000100:00100000:1.0:1790100554.195135:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141024640 00000100:00100000:1.0:1790100554.195174:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790100554.195182:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+12:3644:x1877056141024640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100554.195222:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+12:3644:x1877056141024640:12345-0@lo:400:kworker.0 Request processed in 41us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100554.195228:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790100554.195274:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141024768 00000100:00100000:1.0:1790100554.195278:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141024768 00000100:00100000:1.0:1790100554.195296:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100554.195301:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877056141024768:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790100554.195317:0:17186:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790100554.214068:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877056141024768:12345-0@lo:38:kworker.0 Request processed in 18758us (19066us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790100554.214082:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790100554.214102:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100554.214108:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790100554.214112:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141024768:0@lo:38:kworker.0 00000100:00100000:1.0:1790100554.214141:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141024640:0@lo:400:kworker.0 00010000:00010000:2.0:1790100554.506011:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100555.089447:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790100555.530032:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100556.041432:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790100556.104471:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:2.0:1790100556.553280:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100557.132874:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790100557.576896:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790100557.805864:0:17912:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790100557.805869:0:17912:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790100557.805871:0:17912:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790100557.805990:0:17912:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9261b5ae0000 00000020:01000004:3.0:1790100557.806005:0:17912:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1790100557.806016:0:17912:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790100557.806034:0:17912:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9260829619c0) 00000020:00000080:3.0:1790100557.806049:0:17912:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790100557.896758:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1790100557.897371:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790100557.898364:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1790100557.898570:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790100557.899128:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790100557.899447:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1790100557.899924:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1790100557.900582:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1790100557.901301:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790100557.902151:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790100557.902444:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790100557.902622:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790100557.902851:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1790100557.903293:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1790100557.906436:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790100557.906681:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790100557.907215:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790100557.907660:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790100557.907952:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.908580:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.908852:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.909291:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.909579:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.909821:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.910388:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.910874:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.911282:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.911603:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.911844:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.912217:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.912472:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.912676:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.913195:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.913452:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.913650:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.913946:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.914403:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.914603:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.914857:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.915250:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.915757:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.916117:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1790100557.916503:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.916784:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.917201:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1790100557.917475:0:17912:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00080000:01000000:3.0:1790100557.918514:0:17912:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790100557.919264:0:17912:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1790100557.919275:0:17912:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790100557.919286:0:17912:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f2298287d4d 00000020:01000004:3.0:1790100557.919292:0:17912:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790100557.919313:0:17912:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790100557.919317:0:17912:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790100557.919321:0:17912:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790100557.919422:0:17912:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790100557.919426:0:17912:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1790100557.929808:0:17912:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790100557.929852:0:17912:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1790100557.929857:0:17912:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790100557.929858:0:17912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790100557.929860:0:17912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100557.929861:0:17912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100557.929862:0:17912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100557.929863:0:17912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100557.929864:0:17912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100557.929866:0:17912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100557.929867:0:17912:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790100557.929871:0:17912:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1790100557.929874:0:17912:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790100557.929875:0:17912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790100557.929876:0:17912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100557.929877:0:17912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100557.929879:0:17912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100557.929880:0:17912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100557.929881:0:17912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100557.929882:0:17912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100557.929883:0:17912:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790100557.929935:0:17912:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790100557.929954:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025280:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790100557.930033:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100557.930083:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100557.930728:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141025280 00000100:00100000:2.0:1790100557.930738:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141025280 00000100:00100000:2.0:1790100557.930789:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790100557.930801:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+12:17912:x1877056141025280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790100557.930833:0:17174:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790100557.930836:0:17174:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1790100557.930843:0:17174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1790100557.932626:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+12:17912:x1877056141025280:12345-0@lo:253:mount.lustre.0 Request processed in 1822us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100557.932653:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100557.932790:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025280:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790100557.932803:0:17912:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1790100557.932807:0:17912:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100557.932808:0:17912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790100557.932809:0:17912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100557.932811:0:17912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100557.932812:0:17912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100557.932813:0:17912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100557.932814:0:17912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790100557.932815:0:17912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100557.932817:0:17912:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790100557.932834:0:17912:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9261b5ae0000 from lustre-MDT0001 10000000:01000000:3.0:1790100557.932862:0:17912:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1790100557.932865:0:17912:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790100557.932871:0:17912:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9261b79fcd40 local copy 00010000:00010000:3.0:1790100557.932880:0:17912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100557.933006:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100557.933050:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100557.933123:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790100557.933572:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141025408 00000100:00100000:1.0:1790100557.933580:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141025408 00000100:00100000:1.0:1790100557.933626:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790100557.933635:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17912:x1877056141025408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100557.933725:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+12:17912:x1877056141025408:12345-0@lo:501:mount.lustre.0 Request processed in 91us (674us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100557.933732:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790100557.934396:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025408:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790100557.934415:0:17912:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790100557.934443:0:17912:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790100557.934450:0:17912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.934460:0:17912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100557.934509:0:17912:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9261b5ae0000 10000000:01000000:0.0:1790100557.934513:0:17912:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790100557.934518:0:17912:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9261b79fcd40 10000000:01000000:0.0:1790100557.934520:0:17912:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790100557.934523:0:17912:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9261b79fcd40 from 1 10000000:01000000:0.0:1790100557.934526:0:17912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790100557.934554:0:17912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f2298287d54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.934563:0:17912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f2298287d54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.934571:0:17912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f2298287d54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100557.934588:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100557.934625:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100557.934707:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100557.935521:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141025536 00000100:00100000:2.0:1790100557.935528:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141025536 00000100:00100000:2.0:1790100557.935621:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790100557.935630:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+12:17912:x1877056141025536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100557.935643:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100557.935657:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083927800/0xc87a4f2298287d5b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287d54 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100557.935678:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083927800/0xc87a4f2298287d5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287d54 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100557.935698:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083927800/0xc87a4f2298287d5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287d54 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100557.935706:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927800, rc 0) 00000100:00100000:2.0:1790100557.935751:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+13:17912:x1877056141025536:12345-0@lo:101:mount.lustre.0 Request processed in 122us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100557.935757:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790100557.935825:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100557.935841:0:17912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f2298287d54 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d5b expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.935849:0:17912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f2298287d54 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287d5b expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100557.935876:0:17912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790100557.935888:0:17912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f2298287d54 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d5b expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.935919:0:17912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565d000/0xc87a4f2298287d54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d5b expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100557.935933:0:17912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9261b5ae0000 10000000:01000000:0.0:1790100557.935946:0:17912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790100557.935950:0:17912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9261b5ae0000 from 1 10000000:01000000:0.0:1790100557.935952:0:17912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790100557.935971:0:17912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565da00/0xc87a4f2298287d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.935989:0:17912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565da00/0xc87a4f2298287d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.935996:0:17912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565da00/0xc87a4f2298287d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100557.936010:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100557.936046:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100557.938294:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100557.938519:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141025664 00000100:00100000:3.0:1790100557.938528:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141025664 00000100:00100000:3.0:1790100557.938573:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100557.938580:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+13:17912:x1877056141025664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100557.938594:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100557.938611:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287d62 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100557.938655:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287d62 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100557.938672:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7a00/0xc87a4f2298287d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287d62 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100557.938681:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7a00, rc 0) 00000100:00100000:3.0:1790100557.938805:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+14:17912:x1877056141025664:12345-0@lo:101:mount.lustre.0 Request processed in 225us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100557.938812:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790100557.939307:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100557.939325:0:17912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565da00/0xc87a4f2298287d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d69 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.939334:0:17912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565da00/0xc87a4f2298287d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287d69 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100557.939380:0:17912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790100557.939395:0:17912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565da00/0xc87a4f2298287d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d69 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.939412:0:17912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565da00/0xc87a4f2298287d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d69 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100557.939420:0:17912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790100557.939424:0:17912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790100557.939429:0:17912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9261b5ae0000 10000000:01000000:0.0:1790100557.939433:0:17912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790100557.939437:0:17912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1790100557.939439:0:17912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790100557.939466:0:17912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298287d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.939474:0:17912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298287d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.939482:0:17912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298287d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100557.939499:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100557.939533:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100557.939555:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100557.939609:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141025792 00000100:00100000:2.0:1790100557.939614:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141025792 00000100:00100000:2.0:1790100557.939641:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100557.939648:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+14:17912:x1877056141025792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100557.939657:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100557.939667:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083927600/0xc87a4f2298287d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287d70 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100557.939682:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083927600/0xc87a4f2298287d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287d70 expref: 15 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100557.939770:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083927600/0xc87a4f2298287d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287d70 expref: 15 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100557.939778:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927600, rc 0) 00000100:00100000:2.0:1790100557.939819:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141025792:12345-0@lo:101:mount.lustre.0 Request processed in 171us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100557.939824:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790100557.940254:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100557.940267:0:17912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298287d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d77 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100557.940275:0:17912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298287d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287d77 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100557.943483:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1790100557.944594:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100557.949537:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790100557.949589:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1790100557.949601:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1790100557.949611:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1790100557.949622:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1790100557.949632:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1790100557.949642:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1790100557.949654:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1790100557.949666:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1790100557.949677:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1790100557.949755:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1790100557.949773:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1790100557.949787:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1790100557.949800:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1790100557.949812:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1790100557.949826:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1790100557.949840:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1790100557.949852:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1790100557.949864:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1790100557.949875:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1790100557.949886:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1790100557.949897:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1790100557.949921:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1790100557.950144:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1790100557.950152:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1790100557.950495:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100557.950563:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100557.950668:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947bef00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100557.951241:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141025920 00000100:00100000:2.0:1790100557.951487:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141025920 00000100:00100000:2.0:1790100557.951582:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790100557.951592:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141025920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100557.951770:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141025920:12345-0@lo:501:mount.lustre.0 Request processed in 179us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100557.951777:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790100557.951848:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141025920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100557.951890:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141026048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100557.951951:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100557.952935:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947bef00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100557.953209:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141026048 00000100:00100000:3.0:1790100557.953215:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141026048 00000100:00100000:3.0:1790100557.953260:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790100557.953269:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141026048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100557.954523:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141026048:12345-0@lo:503:mount.lustre.0 Request processed in 1251us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100557.954532:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790100557.954665:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141026048:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790100557.955560:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100557.955637:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141026176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100557.955685:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100557.955848:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926183b156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100557.955883:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141026176 00000100:00100000:3.0:1790100557.955889:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141026176 00000100:00100000:3.0:1790100557.956188:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790100557.956199:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141026176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100557.957299:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141026176:12345-0@lo:502:mount.lustre.0 Request processed in 1098us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100557.957309:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790100557.957684:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141026176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790100557.957897:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790100557.958152:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1790100557.958180:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1790100557.958196:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1790100557.958210:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1790100557.958231:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1790100557.958247:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1790100557.958259:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1790100557.958271:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1790100557.958282:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1790100557.958296:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1790100557.958308:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1790100557.958321:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1790100557.958333:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1790100557.958381:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1790100557.958394:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1790100557.958408:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1790100557.958421:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1790100557.958446:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1790100557.958461:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1790100557.958473:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1790100557.958485:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1790100557.958499:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1790100557.958511:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1790100557.958522:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1790100557.958535:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1790100557.958547:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1790100557.958559:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1790100557.958570:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1790100557.958581:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1790100557.958605:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1790100557.958621:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1790100557.958633:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1790100557.958645:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1790100557.958656:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1790100557.958667:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1790100557.958681:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1790100557.958706:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1790100557.958720:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1790100557.958733:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1790100557.958745:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1790100557.958759:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1790100557.958774:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1790100557.958788:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1790100557.958820:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141026304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100557.958876:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100557.958909:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261947be9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100557.959203:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141026304 00000100:00100000:2.0:1790100557.959211:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141026304 00000100:00100000:2.0:1790100557.959263:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790100557.959272:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141026304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100557.959401:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141026304:12345-0@lo:502:mount.lustre.0 Request processed in 129us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100557.959408:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790100557.960302:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141026304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790100557.960397:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1790100557.960417:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1790100557.961715:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100557.961728:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100557.961731:0:17916:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790100557.961737:0:17916:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1790100557.961740:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790100557.961762:0:17916:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff92608323b380) 00000020:00000080:2.0:1790100557.961783:0:17916:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1790100557.961790:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790100557.961860:0:17916:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790100557.961868:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f2298287d85 00000020:00000080:2.0:1790100557.962451:0:17916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790100557.962457:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100557.962461:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100557.962462:0:17916:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790100557.962465:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100557.962468:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100557.962469:0:17916:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1790100557.962472:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790100557.962480:0:17916:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff92608323cd40) 00000020:00000080:2.0:1790100557.962491:0:17916:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1790100557.962495:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790100557.962497:0:17916:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1790100557.962500:0:17916:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1790100557.962505:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790100557.962565:0:17916:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261b5ae0000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1790100557.962587:0:17916:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9261a6944d40) 00000020:00000080:2.0:1790100557.962597:0:17916:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1790100557.962654:0:17916:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790100557.962659:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298287d9a 00000020:00000080:2.0:1790100557.963292:0:17916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1790100557.963301:0:17916:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790100557.963307:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc87a4f2298287da1 00080000:01000000:2.0:1790100557.963313:0:17916:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790100557.963317:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f2298287da8 00010000:00010000:2.0:1790100558.044296:0:17916:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1790100558.044788:0:17916:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1790100558.045039:0:17916:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790100558.048438:0:17916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1790100558.048452:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100558.048457:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.048459:0:17916:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1790100558.048462:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100558.048467:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.048467:0:17916:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1790100558.048469:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790100558.048473:0:17916:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:00000080:0.0:1790100558.048495:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100558.048508:0:17916:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9261b7974d40) 00000020:00000080:0.0:1790100558.048529:0:17916:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1790100558.048535:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790100558.048617:0:17916:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1790100558.048624:0:17916:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790100558.048631:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f2298287db6 00010000:00080000:0.0:1790100558.048664:0:17916:0:(ldlm_lib.c:102:import_set_conn()) imp ffff926083b69800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790100558.050480:0:17916:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1790100558.051430:0:17916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790100558.051447:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790100558.051478:0:17916:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790100558.051493:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298287dbd 00000100:00080000:2.0:1790100558.051567:0:17916:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790100558.051576:0:17916:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff926083b69800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100558.051604:0:17916:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c55880 x1877056141026432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100558.051624:0:17916:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790100558.051655:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141026432:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1790100558.051687:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100558.051691:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100558.051693:0:17916:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1790100558.051695:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790100558.051698:0:17916:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1790100558.051699:0:17916:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790100558.051701:0:17916:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790100558.051702:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790100558.051704:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100558.051706:0:17916:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790100558.051708:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100558.051712:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100558.051713:0:17916:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:1.0:1790100558.051716:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1790100558.051717:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790100558.051741:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141026432 00000100:00100000:2.0:1790100558.051748:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141026432 00000100:00100000:2.0:1790100558.051775:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100558.051782:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1877056141026432:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790100558.051803:0:17185:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000100:00080000:0.0:1790100558.051806:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790100558.051811:0:17873:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790100558.051813:0:17873:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100558.051817:0:17873:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 405 00000100:00080000:0.0:1790100558.051820:0:17873:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790100558.051826:0:17873:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9261a6139800 using connection 192.168.203.113@tcp/0@lo 00000020:00000080:2.0:1790100558.051833:0:17185:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298287dc4 00000100:00100000:0.0:1790100558.051840:0:17873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6255880 x1877056141026560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:2.0:1790100558.051845:0:17185:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790100558.051851:0:17185:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1790100558.051858:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100558.051861:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100558.051867:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100558.051870:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790100558.051903:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141026688:0@lo:400:kworker.0 00000100:00100000:0.0:1790100558.051931:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:2.0:1790100558.051942:0:17916:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790100558.051958:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100558.051961:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100558.051963:0:17916:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:0.0:1790100558.051964:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141026688 00000020:01000000:2.0:1790100558.051965:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790100558.051967:0:17916:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000100:00100000:0.0:1790100558.051967:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141026688 00000020:01000000:2.0:1790100558.051969:0:17916:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790100558.051970:0:17916:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790100558.051971:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790100558.051974:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100558.051975:0:17916:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790100558.051977:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790100558.051981:0:17916:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790100558.051984:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100558.051985:0:17916:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790100558.051988:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790100558.051992:0:17916:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000100:00100000:0.0:1790100558.051993:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100558.051998:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141026688:12345-0@lo:400:kworker.0 00000020:01000000:2.0:1790100558.052009:0:17916:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790100558.052012:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790100558.052022:0:17916:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9261a6943380) 00000020:00000080:2.0:1790100558.052033:0:17916:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00100000:0.0:1790100558.052038:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141026688:12345-0@lo:400:kworker.0 Request processed in 40us (107us total) trans 0 rc 0/0 00000020:00000080:2.0:1790100558.052039:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1790100558.052044:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790100558.052076:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9261a6256680 x1877056141026688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100558.052088:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141026688:0@lo:400:kworker.0 00000004:00080000:2.0:1790100558.052090:0:17916:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1790100558.052095:0:17916:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790100558.052100:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f2298287dd2 00010000:00080000:2.0:1790100558.052125:0:17916:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9261a62f9000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.113@tcp at head 00000100:00100000:1.0:1790100558.052133:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141026560:0@lo:38:kworker.0 00000100:00100000:1.0:1790100558.052158:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100558.052285:0:17186:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1790100558.052292:0:17186:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:2.0:1790100558.052360:0:17916:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1790100558.052460:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141026560 00000100:00100000:0.0:1790100558.052464:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141026560 00000100:00100000:1.0:1790100558.052564:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100558.052569:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1877056141026560:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1790100558.052647:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1877056141026560:12345-0@lo:38:kworker.0 Request processed in 76us (488us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790100558.052653:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100558.052694:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100558.052700:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100558.052704:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790100558.052707:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141026560:0@lo:38:kworker.0 00000040:01000000:2.0:1790100558.053098:0:17916:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790100558.053276:0:17916:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790100558.054632:0:17916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100558.055579:0:17916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1790100558.055743:0:17916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1790100558.057170:0:17922:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790100558.057176:0:17922:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1790100558.058331:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9261b7669000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100558.058484:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1877056141026432:12345-0@lo:38:llog_process_th.0 Request processed in 6698us (6764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.058495:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100558.058688:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100558.058698:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790100558.058706:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790100558.058721:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790100558.058725:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083b69800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790100558.058777:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141026432:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1790100558.059266:0:17916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790100558.059280:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100558.059323:0:17916:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790100558.059372:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298287dd9 00000100:00080000:0.0:1790100558.059379:0:17916:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100558.059388:0:17916:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9261a62f9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100558.059417:0:17916:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6255880 x1877056141026816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100558.059440:0:17916:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790100558.059466:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100558.059470:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100558.059473:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100558.059476:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1790100558.059524:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100558.059528:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.059530:0:17916:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790100558.059534:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790100558.059536:0:17916:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1790100558.059538:0:17916:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100558.059539:0:17916:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100558.059541:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790100558.059543:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.059544:0:17916:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790100558.059547:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100558.059551:0:17916:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790100558.059560:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.059561:0:17916:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790100558.059564:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790100558.059568:0:17916:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:0.0:1790100558.059587:0:17916:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790100558.059590:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100558.059601:0:17916:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9261b7973380) 00000020:00000080:0.0:1790100558.059613:0:17916:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1790100558.059617:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790100558.059692:0:17916:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1790100558.059698:0:17916:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790100558.059704:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc87a4f2298287de7 00010000:00080000:0.0:1790100558.059728:0:17916:0:(ldlm_lib.c:102:import_set_conn()) imp ffff926083b6a800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790100558.059932:0:17916:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1790100558.059997:0:17916:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790100558.060011:0:17916:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1790100558.060335:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141026816:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790100558.060388:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141026816 offset 0 length 520: 4 00000100:00100000:2.0:1790100558.061436:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141026944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100558.061483:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100558.061604:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141026944 00000100:00100000:0.0:1790100558.061612:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141026944 00000100:00100000:0.0:1790100558.061652:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100558.061660:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1877056141026944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790100558.061690:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790100558.061765:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1877056141026944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100558.061772:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1790100558.062149:0:17916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790100558.062461:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141026944:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1790100558.062519:0:17916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1790100558.062631:0:17916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790100558.063296:0:17924:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790100558.063301:0:17924:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790100558.063971:0:17916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790100558.063981:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100558.064013:0:17916:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790100558.064038:0:17916:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298287dee 00000100:00080000:0.0:1790100558.064047:0:17916:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100558.064057:0:17916:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff926083b6a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100558.064097:0:17916:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6256680 x1877056141027072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100558.064122:0:17916:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790100558.064186:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100558.064190:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.064192:0:17916:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790100558.064195:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1790100558.064197:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141027072:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1790100558.064198:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.064200:0:17916:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790100558.064203:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790100558.064204:0:17916:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790100558.064206:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100558.064208:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.064209:0:17916:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790100558.064211:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100558.064213:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.064214:0:17916:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790100558.064217:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790100558.064253:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100558.064256:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100558.064257:0:17916:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790100558.064260:0:17916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000400:00000100:2.0:1790100558.064268:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141027072 offset 0 length 520: 4 00000020:01000000:3.0:1790100558.064363:0:17912:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1790100558.064399:0:17912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790100558.064427:0:17912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298287d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d77 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.064437:0:17912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565c600/0xc87a4f2298287d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287d77 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100558.064446:0:17912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9261b5ae0000 from 1 10000000:01000000:3.0:1790100558.064449:0:17912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:1.0:1790100558.064457:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100558.064463:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100558.064466:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00010000:3.0:1790100558.064474:0:17912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790100558.064476:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790100558.064486:0:17912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.064498:0:17912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100558.064514:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100558.064551:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100558.064582:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992840 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.064637:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141027200 00000100:00100000:2.0:1790100558.064644:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141027200 00000100:00100000:2.0:1790100558.064685:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790100558.064694:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+15:17912:x1877056141027200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100558.064706:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100558.064718:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287df5 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.064740:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 16 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.064750:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 16 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.064768:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926800, rc 0) 00000100:00100000:2.0:1790100558.064842:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+16:17912:x1877056141027200:12345-0@lo:101:mount.lustre.0 Request processed in 149us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.064848:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100558.064910:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100558.064922:0:17912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.064931:0:17912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100558.065680:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027328:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790100558.065718:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100558.065747:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082abeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100558.065918:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141027328 00000100:00100000:3.0:1790100558.065923:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141027328 00000100:00100000:3.0:1790100558.065949:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790100558.065960:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+16:17912:x1877056141027328:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790100558.065972:0:17175:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790100558.065984:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790100558.065986:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790100558.066046:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+16:17912:x1877056141027328:12345-0@lo:256:mount.lustre.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100558.066051:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790100558.066108:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027328:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790100558.066733:0:17912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100558.066756:0:17912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100558.066767:0:17912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100558.066773:0:17912:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b5ae0000 from 1 10000000:01000000:0.0:1790100558.066776:0:17912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100558.066799:0:17912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100558.066820:0:17912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100558.066829:0:17912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100558.066843:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100558.066875:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100558.066908:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082abeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.067039:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141027456 00000100:00100000:2.0:1790100558.067044:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141027456 00000100:00100000:2.0:1790100558.067078:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100558.067085:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+16:17912:x1877056141027456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100558.067094:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100558.067105:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287e03 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.067124:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 17 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.067135:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 17 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.067147:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926a00, rc 0) 00000100:00100000:2.0:1790100558.067329:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027456:12345-0@lo:101:mount.lustre.0 Request processed in 244us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.067367:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790100558.067749:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100558.067764:0:17912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.067772:0:17912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790100558.067904:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100558.067938:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100558.067982:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100558.068062:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260849929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100558.068100:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141027584 00000100:00100000:0.0:1790100558.068105:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141027584 00000100:00100000:0.0:1790100558.068253:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790100558.068262:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100558.068371:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027584:12345-0@lo:501:mount.lustre.0 Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100558.068378:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790100558.068441:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100558.068467:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100558.068504:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100558.068583:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260849929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.068608:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141027712 00000100:00100000:2.0:1790100558.068613:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141027712 00000100:00100000:2.0:1790100558.068634:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790100558.068641:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027712:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100558.068717:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027712:12345-0@lo:503:mount.lustre.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.068729:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100558.068808:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027712:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790100558.069119:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100558.069201:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100558.069249:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100558.069270:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.069380:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141027840 00000100:00100000:2.0:1790100558.069384:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141027840 00000100:00100000:2.0:1790100558.069411:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790100558.069418:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100558.069499:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027840:12345-0@lo:502:mount.lustre.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.069505:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790100558.069714:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100558.070170:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790100558.070197:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1790100558.070211:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1790100558.070251:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1790100558.070266:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1790100558.070278:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1790100558.070290:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1790100558.070302:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1790100558.070315:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790100558.070327:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1790100558.070373:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1790100558.070401:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100558.070443:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.073460:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182fafcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.073504:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141027968 00000100:00100000:2.0:1790100558.073514:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141027968 00000100:00100000:2.0:1790100558.073567:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790100558.073576:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100558.073725:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141027968:12345-0@lo:502:mount.lustre.0 Request processed in 148us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.073733:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790100558.073901:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141027968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100558.073966:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1790100558.073978:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790100558.074836:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100558.074845:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100558.074846:0:17926:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790100558.074851:0:17926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261b5ae0000 00000020:00000080:1.0:1790100558.074853:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100558.074858:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100558.074860:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100558.074861:0:17926:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790100558.074862:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100558.074863:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100558.074870:0:17926:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790100558.074872:0:17926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261b5ae0000 00000020:00000080:1.0:1790100558.074874:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100558.074915:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100558.074917:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100558.074918:0:17926:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790100558.074919:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100558.074921:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100558.074922:0:17926:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790100558.074924:0:17926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261b5ae0000 00000020:00000080:1.0:1790100558.074925:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100558.074934:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100558.074936:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100558.074936:0:17926:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790100558.074938:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100558.074939:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100558.074940:0:17926:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790100558.074942:0:17926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261b5ae0000 00000020:00000080:1.0:1790100558.074943:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790100558.074954:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100558.074956:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100558.074957:0:17926:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790100558.074959:0:17926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1790100558.075003:0:17912:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790100558.075187:0:17912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100558.075209:0:17912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.075221:0:17912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100558.075278:0:17912:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790100558.075281:0:17912:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9261b5ae0000 10000000:01000000:3.0:1790100558.075284:0:17912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9261b5ae0000 10000000:01000000:3.0:1790100558.075287:0:17912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790100558.075292:0:17912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b5ae0000 from 1 10000000:01000000:3.0:1790100558.075295:0:17912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790100558.075323:0:17912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298287e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.075331:0:17912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298287e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.075362:0:17912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298287e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100558.075384:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100558.075433:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100558.075471:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9260849920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.075579:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141028096 00000100:00100000:2.0:1790100558.075584:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141028096 00000100:00100000:2.0:1790100558.075623:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790100558.075633:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+17:17912:x1877056141028096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100558.075644:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100558.075656:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926000/0xc87a4f2298287e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287e11 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.075677:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926000/0xc87a4f2298287e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287e11 expref: 18 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.075687:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926000/0xc87a4f2298287e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e11 expref: 18 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.075943:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926000, rc 0) 00000100:00100000:2.0:1790100558.075991:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028096:12345-0@lo:101:mount.lustre.0 Request processed in 359us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.075998:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790100558.076325:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100558.076364:0:17912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298287e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e18 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100558.076374:0:17912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298287e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287e18 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100558.078013:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1790100558.078418:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100558.078604:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1790100558.078628:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1790100558.078641:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1790100558.078653:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1790100558.078666:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1790100558.078680:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1790100558.078693:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1790100558.078900:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1790100558.078991:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1790100558.079008:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1790100558.079090:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1790100558.079105:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1790100558.079118:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1790100558.079132:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1790100558.079145:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1790100558.079222:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1790100558.079247:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1790100558.079258:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1790100558.079268:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1790100558.079280:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1790100558.079293:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1790100558.079304:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1790100558.079316:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1790100558.079329:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1790100558.079508:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1790100558.079528:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1790100558.079543:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1790100558.079554:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1790100558.079575:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1790100558.079580:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1790100558.079665:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100558.079811:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.079893:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf840 going to sleep for 11 seconds 00000100:00100000:3.0:1790100558.081737:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141028224 00000100:00100000:3.0:1790100558.081748:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141028224 00000100:00100000:3.0:1790100558.081902:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790100558.081914:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100558.082083:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028224:12345-0@lo:501:mount.lustre.0 Request processed in 172us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100558.082091:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790100558.082940:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100558.082980:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100558.083017:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.083045:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100558.083392:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141028352 00000100:00100000:1.0:1790100558.083398:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141028352 00000100:00100000:1.0:1790100558.083436:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790100558.083449:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028352:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100558.083545:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028352:12345-0@lo:503:mount.lustre.0 Request processed in 101us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100558.083552:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790100558.083600:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028352:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790100558.084128:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100558.084214:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100558.084263:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.084303:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.084431:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141028480 00000100:00100000:2.0:1790100558.084436:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141028480 00000100:00100000:2.0:1790100558.084465:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100558.084472:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100558.084555:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028480:12345-0@lo:502:mount.lustre.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.084562:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790100558.084646:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100558.084852:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1790100558.084875:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1790100558.084886:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1790100558.084898:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1790100558.084909:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1790100558.084992:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1790100558.085006:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1790100558.085017:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1790100558.085027:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1790100558.085047:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1790100558.085058:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1790100558.085069:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1790100558.085079:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1790100558.085089:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1790100558.085100:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1790100558.085111:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1790100558.085131:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1790100558.085144:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1790100558.085155:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1790100558.085240:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1790100558.085255:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1790100558.085266:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1790100558.085277:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1790100558.085288:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1790100558.085299:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1790100558.085310:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1790100558.085320:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1790100558.085330:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1790100558.085371:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1790100558.085387:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1790100558.085399:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1790100558.085410:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1790100558.085432:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1790100558.085447:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1790100558.085460:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1790100558.085473:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1790100558.085485:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1790100558.085498:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1790100558.085510:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1790100558.085523:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1790100558.085535:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1790100558.085548:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1790100558.085570:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1790100558.085583:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1790100558.085594:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1790100558.085603:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1790100558.085614:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1790100558.085624:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1790100558.085671:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100558.085838:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.085923:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.087080:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141028608 00000100:00100000:2.0:1790100558.087093:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141028608 00000100:00100000:2.0:1790100558.087150:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790100558.087170:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100558.087332:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028608:12345-0@lo:502:mount.lustre.0 Request processed in 174us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.087355:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790100558.087479:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100558.087726:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1790100558.087764:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1790100558.087798:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100558.087846:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.087885:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.088057:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141028736 00000100:00100000:2.0:1790100558.088062:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141028736 00000100:00100000:2.0:1790100558.088099:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790100558.088111:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100558.088205:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028736:12345-0@lo:502:mount.lustre.0 Request processed in 94us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.088215:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790100558.088309:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100558.088383:0:17912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1790100558.088392:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790100558.089397:0:17929:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1790100558.089411:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9261b23019c0) 00000020:00000080:1.0:1790100558.089429:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1790100558.089515:0:17929:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261b5ae0000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1790100558.089520:0:17929:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261b5ae0000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1790100558.089523:0:17929:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b5ae0000 3 00010000:00080000:1.0:1790100558.089551:0:17929:0:(ldlm_lib.c:102:import_set_conn()) imp ffff926083dae800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790100558.093149:0:17929:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1790100558.094028:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1790100558.094072:0:17929:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790100558.094092:0:17929:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc87a4f2298287e26 00000100:00080000:1.0:1790100558.094103:0:17929:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790100558.094114:0:17929:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff926083dae800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790100558.094149:0:17929:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926084c11f80 x1877056141028864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100558.094858:0:17929:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790100558.094877:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100558.094881:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790100558.094884:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100558.094887:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790100558.095078:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877056141028864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790100558.095142:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.095253:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141028864 00000100:00100000:1.0:1790100558.095260:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141028864 00000100:00100000:1.0:1790100558.095308:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100558.095315:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877056141028864:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790100558.095372:0:17182:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:1.0:1790100558.095401:0:17182:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc87a4f2298287e2d 00000004:00100000:1.0:1790100558.095415:0:17182:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790100558.095440:0:17182:0:(import.c:65:import_set_state_nolock()) ffff926083163000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100558.096512:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877056141028864:12345-0@lo:38:llog_process_th.0 Request processed in 1192us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100558.096521:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1790100558.096623:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00010000:00080000:3.0:1790100558.096777:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff926084c11f80 x1877056141028864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100558.096788:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100558.096797:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1790100558.096803:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790100558.096808:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790100558.096810:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083dae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790100558.096816:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877056141028864:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1790100558.100796:0:17912:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790100558.100839:0:17912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790100558.100855:0:17912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298287e11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e18 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.100867:0:17912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b6200/0xc87a4f2298287e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e18 expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790100558.100915:0:17912:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790100558.100917:0:17912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790100558.100919:0:17912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100558.100920:0:17912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100558.100921:0:17912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100558.100922:0:17912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100558.100924:0:17912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100558.100925:0:17912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100558.100926:0:17912:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790100558.100930:0:17912:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1790100558.100932:0:17912:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100558.100934:0:17912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790100558.100935:0:17912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100558.100936:0:17912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100558.100937:0:17912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100558.100938:0:17912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100558.100939:0:17912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100558.100940:0:17912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100558.100941:0:17912:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790100558.100965:0:17912:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790100558.100983:0:17912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790100558.101042:0:17912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100558.101086:0:17912:0:(client.c:2716:ptlrpc_set_wait()) set ffff926184ed3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100558.101238:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141028992 00000100:00100000:3.0:1790100558.101245:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141028992 00000100:00100000:3.0:1790100558.101292:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790100558.101301:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790100558.101325:0:17174:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790100558.101382:0:17174:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1790100558.104022:0:17160:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1790100558.104086:0:17174:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790100558.104103:0:17174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1790100558.104413:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+18:17912:x1877056141028992:12345-0@lo:253:mount.lustre.0 Request processed in 3109us (3366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100558.104424:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790100558.104646:0:17912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:17912:1877056141028992:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790100558.104662:0:17912:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790100558.104665:0:17912:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790100558.104667:0:17912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790100558.104668:0:17912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100558.104669:0:17912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100558.104671:0:17912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100558.104672:0:17912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100558.104673:0:17912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790100558.104675:0:17912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100558.104676:0:17912:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790100558.104688:0:17912:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1790100558.106048:0:17196:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790100558.106056:0:17196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790100558.106075:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.106100:0:17196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.106107:0:17196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 17 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.106115:0:17196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.106148:0:17196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 17 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.106203:0:17196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 17 pid: 17173 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100558.106218:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141029120:0@lo:104: 00000100:00100000:2.0:1790100558.106280:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100558.106382:0:17196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.106391:0:17196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 17 pid: 17174 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100558.106400:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141029248:0@lo:104: 00000100:00100000:2.0:1790100558.106421:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100558.111241:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ed2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100558.112730:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141029120 00000100:00100000:3.0:1790100558.112741:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141029120 00000100:00100000:3.0:1790100558.112779:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141029248 00000100:00100000:3.0:1790100558.112782:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141029248 00000100:00100000:3.0:1790100558.112797:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100558.112805:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:687676b7-da9e-40a3-8051-3299bac6cf99+4:17196:x1877056141029120:12345-0@lo:104: 00010000:00010000:3.0:1790100558.112821:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113021:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100558.113027:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:687676b7-da9e-40a3-8051-3299bac6cf99+4:17196:x1877056141029120:12345-0@lo:104: Request processed in 224us (6747us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100558.113035:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100558.113053:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100558.113058:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:687676b7-da9e-40a3-8051-3299bac6cf99+3:17196:x1877056141029248:12345-0@lo:104: 00010000:00010000:3.0:1790100558.113066:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113098:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100558.113103:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:687676b7-da9e-40a3-8051-3299bac6cf99+3:17196:x1877056141029248:12345-0@lo:104: Request processed in 45us (6681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100558.113108:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790100558.113134:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100558.113140:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113147:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100558.113151:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113391:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100558.113398:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100558.113403:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100558.113436:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113443:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100558.113461:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113469:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a63b7200/0xc87a4f2298287df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287dfc expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113480:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100558.113483:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113489:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100558.113492:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113499:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100558.113505:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100558.113516:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100558.113528:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113534:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100558.113540:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113546:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926184b8f200/0xc87a4f2298287d31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287d38 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113557:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100558.113559:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100558.113561:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100558.113580:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141029376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100558.113613:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100558.113637:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100558.113643:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141029504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100558.113662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100558.113690:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141029376 00000100:00100000:3.0:1790100558.113694:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141029376 00010000:00010000:3.0:1790100558.113711:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 18 pid: 17173 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100558.113730:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141029504 00000100:00100000:3.0:1790100558.113733:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141029504 00010000:00010000:3.0:1790100558.113743:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 19 pid: 17174 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100558.113767:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100558.113773:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:687676b7-da9e-40a3-8051-3299bac6cf99+19:3643:x1877056141029376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100558.113784:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100558.113790:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 19 pid: 17173 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113800:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 19 pid: 17173 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113814:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100558.113840:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:687676b7-da9e-40a3-8051-3299bac6cf99+19:3643:x1877056141029376:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100558.113846:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100558.113859:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100558.113865:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:687676b7-da9e-40a3-8051-3299bac6cf99+18:3643:x1877056141029504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100558.113872:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100558.113875:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 18 pid: 17174 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113884:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 18 pid: 17174 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113895:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.113904:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790100558.115244:0:17165:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009187787s 00010000:00010000:3.0:1790100558.115252:0:17165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.115261:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.115269:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.115276:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.115282:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100558.115286:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.115294:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.115306:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100558.115316:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100558.115376:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:687676b7-da9e-40a3-8051-3299bac6cf99+18:3643:x1877056141029504:12345-0@lo:103:ldlm_bl.0 Request processed in 1509us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100558.115385:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100558.115441:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141029504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100558.115452:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141029376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100558.115709:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100558.115851:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926800/0xc87a4f2298287dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287df5 expref: 17 pid: 17173 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100558.115875:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141029120:0@lo:104: 00010000:00010000:2.0:1790100558.115888:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083927000/0xc87a4f2298287d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287d31 expref: 16 pid: 17174 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100558.115896:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141029248:0@lo:104: 00010000:00010000:2.0:1790100558.115913:0:17196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.115932:0:17196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.115939:0:17196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100558.115945:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926400/0xc87a4f2298287e34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1790100558.121071:0:17912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1790100558.121741:0:17938:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790100558.122124:0:17912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:2.0:1790100558.122804:0:17937:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1790100558.122808:0:17937:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1790100558.124770:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100558.126519:0:17939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17939:1877056141029632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.126585:0:17939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.126635:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141029632 00000100:00100000:1.0:1790100558.126643:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141029632 00000100:00100000:1.0:1790100558.126686:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100558.126695:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17939:x1877056141029632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.126759:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17939:x1877056141029632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100558.126766:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100558.126787:0:17939:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf480 going to sleep for 11 seconds 00000100:00100000:1.0:1790100558.126807:0:17939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17939:1877056141029632:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1790100558.126830:0:17939:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1790100558.126851:0:17939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17939:1877056141029760:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.126877:0:17939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.126891:0:17939:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf480 going to sleep for 11 seconds 00000040:00080000:0.0:1790100558.127831:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790100558.127891:0:17938:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1790100558.128041:0:17912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1790100558.128075:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790100558.128534:0:17912:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790100558.128541:0:17912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1790100558.128574:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100558.129501:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141029760 00000100:00100000:1.0:1790100558.129512:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141029760 00000100:00100000:1.0:1790100558.129557:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100558.129565:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17939:x1877056141029760:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.129709:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17939:x1877056141029760:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 145us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100558.129717:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100558.129758:0:17939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17939:1877056141029760:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.129831:0:17939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17939:1877056141029888:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.129863:0:17939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.129887:0:17939:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf780 going to sleep for 11 seconds 00000100:00100000:2.0:1790100558.129901:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141029888 00000100:00100000:2.0:1790100558.129905:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141029888 00000100:00100000:2.0:1790100558.129928:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100558.129936:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17939:x1877056141029888:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790100558.129972:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17939:x1877056141029888:12345-0@lo:900:lod0001_rec0000.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100558.129978:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790100558.129982:0:17939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff926084c12300 x1877056141029888/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790100574 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100558.130005:0:17939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17939:1877056141029888:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.130041:0:17939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17939:1877056141030016:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.130066:0:17939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100558.130081:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141030016 00000100:00100000:1.0:1790100558.130084:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141030016 00000100:00100000:1.0:1790100558.130100:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100558.130104:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17939:x1877056141030016:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790100558.130138:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17939:x1877056141030016:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 34us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100558.130144:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100558.130156:0:17939:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf480 going to sleep for 11 seconds 00000100:00100000:1.0:1790100558.130177:0:17939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17939:1877056141030016:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1790100558.130211:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100558.132499:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790100558.133028:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790100558.133052:0:17912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1790100558.133144:0:17912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790100558.133617:0:17912:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1790100558.136289:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790100558.136415:0:17939:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790100558.136420:0:17939:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1790100558.137280:0:17912:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1790100558.143690:0:17912:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790100558.143736:0:17912:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbae4819b3988 00100000:10000000:2.0:1790100558.143743:0:17912:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1790100558.144115:0:17912:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790100558.144147:0:17912:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790100558.144174:0:17912:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790100558.144190:0:17912:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1790100558.152952:0:17912:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100558.153308:0:17912:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790100558.156933:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790100558.600471:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100559.177650:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790100559.177819:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790100559.624431:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790100560.080755:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790100560.080761:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9261b5ae0000 from 8 10000000:01000000:1.0:1790100560.080766:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100560.080808:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100560.080820:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100560.080839:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100560.080864:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141030144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100560.080925:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100560.080977:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf480 going to sleep for 11 seconds 00000100:00100000:3.0:1790100560.081423:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141030144 00000100:00100000:3.0:1790100560.081431:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141030144 00000100:00100000:3.0:1790100560.081487:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790100560.081498:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+16:17177:x1877056141030144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100560.081511:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100560.081524:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287e3b expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100560.081546:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 17 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100560.081556:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 17 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100560.081563:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7200, rc 0) 00000100:00100000:3.0:1790100560.081606:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141030144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100560.081613:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790100560.081694:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141030144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100560.081710:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100560.081719:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100560.081771:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141030272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790100560.081802:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100560.081823:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182faf480 going to sleep for 11 seconds 00000100:00100000:3.0:1790100560.081865:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141030272 00000100:00100000:3.0:1790100560.081870:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141030272 00000100:00100000:3.0:1790100560.081930:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100560.081938:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141030272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790100560.081954:0:17174:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790100560.081969:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790100560.081972:0:17174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790100560.082060:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141030272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100560.082074:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790100560.082657:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141030272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790100560.082707:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100560.082714:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100560.082722:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100560.082731:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790100560.082733:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926184c6f000 from 8 10000000:01000000:0.0:1790100560.082735:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100560.082757:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100560.082764:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100560.082772:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100560.082786:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141030400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100560.082818:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100560.084181:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082bf5000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100560.084280:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141030400 00000100:00100000:1.0:1790100560.084288:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141030400 00000100:00100000:1.0:1790100560.084332:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790100560.084365:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141030400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100560.084380:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100560.084395:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287e49 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100560.084417:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 18 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100560.084438:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 18 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100560.084446:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f000, rc 0) 00000100:00100000:1.0:1790100560.084498:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:17177:x1877056141030400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100560.084504:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790100560.084599:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141030400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100560.084614:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100560.084623:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100560.084688:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141030528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790100560.084724:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100560.084752:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082bf5000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100560.084791:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141030528 00000100:00100000:1.0:1790100560.084796:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141030528 00000100:00100000:1.0:1790100560.084813:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790100560.084818:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:17177:x1877056141030528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790100560.084831:0:17173:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790100560.084846:0:17173:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790100560.084849:0:17173:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1790100560.084929:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:17177:x1877056141030528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100560.084935:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790100560.088830:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141030528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790100560.088906:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100560.088917:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100560.088929:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100560.200973:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790100560.201331:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790100560.649676:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100561.224422:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00010000:00010000:2.0:1790100561.673042:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100562.248985:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00000001:02000400:3.0:1790100562.292579:0:18181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790100562.704197:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100563.272533:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 0 seconds 00000020:00000004:3.0:1790100563.386981:0:18233:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100563.388980:0:18233:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1790100563.409169:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790100563.409176:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790100563.409179:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100563.409207:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9261a6139800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100563.409229:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083c54e00 x1877056141030784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100563.409247:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100563.409250:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100563.409252:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100563.409255:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100563.409284:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100563.409288:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100563.409291:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100563.409294:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790100563.409324:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141030656:0@lo:400:kworker.0 00000100:00100000:2.0:1790100563.409437:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100563.409489:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100563.409495:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141030912:0@lo:400:kworker.0 00000100:00100000:2.0:1790100563.409521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100563.409556:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141030784:0@lo:38:kworker.0 00000100:00100000:2.0:1790100563.409581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100563.409607:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141031040:0@lo:400:kworker.0 00000100:00100000:2.0:1790100563.409628:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100563.409642:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100563.409648:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056141031168:0@lo:400:kworker.0 00000100:00100000:2.0:1790100563.409670:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100563.409698:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141030912 00000100:00100000:2.0:1790100563.409705:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141030912 00000100:00100000:2.0:1790100563.409754:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141031168 00000100:00100000:2.0:1790100563.409757:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141031168 00000100:00100000:2.0:1790100563.409774:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100563.409783:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141030912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100563.409831:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141030912:12345-0@lo:400:kworker.0 Request processed in 49us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100563.409837:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100563.409855:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100563.409861:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056141031168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100563.409891:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056141031168:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100563.409896:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790100563.409929:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926083c54a80 x1877056141031168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100563.409949:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056141031168:0@lo:400:kworker.0 00010000:00080000:2.0:1790100563.409979:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926083c54000 x1877056141030912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100563.409988:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141030912:0@lo:400:kworker.0 00000100:00100000:1.0:1790100563.410222:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141030656 00000100:00100000:1.0:1790100563.410227:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141030656 00000100:00100000:1.0:1790100563.410263:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790100563.410270:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:3641:x1877056141030656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100563.410307:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:3641:x1877056141030656:12345-0@lo:400:kworker.0 Request processed in 38us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100563.410313:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790100563.410361:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141030784 00000100:00100000:1.0:1790100563.410372:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141030784 00000100:00100000:1.0:1790100563.410391:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141031040 00000100:00100000:1.0:1790100563.410393:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141031040 00000100:00100000:1.0:1790100563.410408:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100563.410413:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877056141030784:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790100563.410435:0:17186:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:1.0:1790100563.410468:0:17186:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298287e57 00000004:00100000:1.0:1790100563.410482:0:17186:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790100563.410488:0:17186:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1790100563.410562:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100563.410569:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100563.410606:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141031040:12345-0@lo:400:kworker.0 Request processed in 38us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100563.410612:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100563.410639:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141031040:0@lo:400:kworker.0 00000100:00100000:1.0:1790100563.410658:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141030656:0@lo:400:kworker.0 00000100:00100000:1.0:1790100563.411291:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141031296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100563.411327:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100563.411378:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141031296 00000100:00100000:1.0:1790100563.411383:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141031296 00000100:00100000:1.0:1790100563.411407:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100563.411414:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141031296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790100563.411439:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790100563.411475:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141031296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100563.411493:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100563.411526:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141031296:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1790100563.420507:0:17186:0:(import.c:65:import_set_state_nolock()) ffff9261bcabb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100563.420608:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1877056141030784:12345-0@lo:38:kworker.0 Request processed in 10192us (11024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100563.420619:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1790100563.420716:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790100563.420726:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790100563.420732:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790100563.420735:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a6139800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1790100563.420749:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001d333471): req@ffff926083284a80 x1877056141023872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100563.420774:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141030784:0@lo:38:kworker.0 00000100:00100000:1.0:1790100563.420874:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100563.420888:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141031424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100563.420948:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100563.420996:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100563.421020:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff92608310f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100563.421022:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141031424 00000100:00100000:1.0:1790100563.421030:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141031424 00000100:00100000:1.0:1790100563.421082:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141023872 00000100:00100000:1.0:1790100563.421086:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141023872 00000100:00100000:0.0:1790100563.421099:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790100563.421115:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056141031424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790100563.421141:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790100563.421197:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1877056141031424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100563.421322:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100563.421367:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790100563.421378:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17221:x1877056141023872:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790100563.421446:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17221:x1877056141023872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 71us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100563.421453:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100563.421511:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141031424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100563.421584:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1877056141023872:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1790100563.421614:0:17221:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1790100563.421649:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1877056141031552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790100563.421680:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100563.421712:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141031552 00000100:00100000:0.0:1790100563.421717:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141031552 00000100:00100000:1.0:1790100563.421727:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083c659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100563.421753:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100563.421758:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17221:x1877056141031552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790100563.421849:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17221:x1877056141031552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 89us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100563.421856:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100563.421874:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1877056141031552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790100563.421936:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1877056141031680:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790100563.421959:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100563.421986:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083c65540 going to sleep for 11 seconds 00000100:00100000:3.0:1790100563.422048:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141031680 00000100:00100000:3.0:1790100563.422060:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141031680 00000100:00100000:3.0:1790100563.422101:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790100563.422109:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17221:x1877056141031680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790100563.422159:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17221:x1877056141031680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100563.422165:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100563.422269:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1877056141031680:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1790100563.422312:0:17221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100563.424756:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790100563.424905:0:17221:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1790100563.424911:0:17221:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1790100563.721956:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790100564.381955:0:18285:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790100564.382164:0:18285:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100564.748921:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790100565.382401:0:18333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe286de970 20000000:00000080:2.0:1790100565.382418:0:18333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff926191606c00 uarg=0000000000000000 20000000:01000000:2.0:1790100565.382458:0:18333:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790100565.382465:0:18333:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790100565.382470:0:18333:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790100565.391179:0:18334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1790100565.391333:0:18333:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790100565.403575:0:18333:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790100565.403607:0:18333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.403879:0:18333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.403902:0:18333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 17 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.403909:0:18333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.403950:0:18333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 17 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.403965:0:18333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 17 pid: 17173 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100565.403977:0:18333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18333:1877056141031808:0@lo:104: 00000100:00100000:3.0:1790100565.404035:0:18333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100565.404079:0:18333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.404087:0:18333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 17 pid: 17175 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100565.404095:0:18333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18333:1877056141031936:0@lo:104: 00000100:00100000:1.0:1790100565.404260:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141031808 00000100:00100000:1.0:1790100565.404267:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141031808 00000100:00100000:1.0:1790100565.404316:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100565.404324:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:18333:x1877056141031808:12345-0@lo:104: 00010000:00010000:1.0:1790100565.404358:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.404413:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100565.404419:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:18333:x1877056141031808:12345-0@lo:104: Request processed in 96us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100565.404426:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790100565.404520:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100565.404527:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.404533:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565de00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100565.404537:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.404545:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100565.404552:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100565.404557:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790100565.404588:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.404593:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100565.404623:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.404630:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565de00/0xc87a4f2298287e03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e0a expref: -99 pid: 17912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.404650:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100565.404652:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100565.404654:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100565.404738:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141032064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100565.404846:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100565.404972:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141032064 00000100:00100000:0.0:1790100565.404977:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141032064 00010000:00010000:0.0:1790100565.404996:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 18 pid: 17173 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100565.405026:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100565.405034:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+18:3643:x1877056141032064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100565.405044:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100565.405048:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 18 pid: 17173 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.405059:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 18 pid: 17173 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.405073:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100565.405284:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141032064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100565.405434:0:18333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100565.405458:0:18333:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082bf5cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1790100565.405471:0:18333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926a00/0xc87a4f2298287e0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287e03 expref: 18 pid: 17173 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100565.405482:0:18333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18333:1877056141031808:0@lo:104: 00000100:00100000:1.0:1790100565.405552:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141031936 00000100:00100000:1.0:1790100565.405557:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141031936 00000100:00100000:1.0:1790100565.405582:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100565.405588:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:18333:x1877056141031936:12345-0@lo:104: 00010000:00010000:1.0:1790100565.405598:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.405647:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100565.405653:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:18333:x1877056141031936:12345-0@lo:104: Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100565.405659:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1790100565.405692:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100565.405697:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.405704:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ee00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100565.405708:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.405715:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100565.405721:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100565.405726:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790100565.405750:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.405756:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100565.405783:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.405790:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926184b8ee00/0xc87a4f2298287d00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287d07 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.405806:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100565.405808:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100565.405809:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100565.405818:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141032192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100565.405847:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100565.405895:0:17165:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790100565.405904:0:17165:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790100565.406231:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+17:3643:x1877056141032064:12345-0@lo:103:ldlm_bl.0 Request processed in 1197us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100565.406239:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100565.406253:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141032192 00000100:00100000:0.0:1790100565.406257:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141032192 00010000:00010000:0.0:1790100565.406272:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 17 pid: 17175 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100565.406274:0:18333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18333:1877056141031936:0@lo:104: 00000100:00100000:0.0:1790100565.406293:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100565.406298:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+17:3644:x1877056141032192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100565.406303:0:18333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406314:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100565.406318:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 17 pid: 17175 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406328:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 17 pid: 17175 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406413:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083927a00/0xc87a4f2298287d07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287d00 expref: 17 pid: 17175 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406428:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406437:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406450:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406457:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406465:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406471:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406476:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100565.406480:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406496:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406522:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.406530:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100565.406561:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+16:3644:x1877056141032192:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100565.406568:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100565.406569:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141032192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100565.406688:0:18333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.406696:0:18333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.406704:0:18333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b6000/0xc87a4f2298287e5e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.769416:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100566.282136:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790100566.792679:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790100567.432490:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100567.432499:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b5ae0000 from 13 10000000:01000000:1.0:1790100567.432505:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100567.432553:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100567.432565:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100567.432575:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100567.432601:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100567.432664:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100567.432707:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100567.432777:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141032320 00000100:00100000:2.0:1790100567.432785:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141032320 00000100:00100000:2.0:1790100567.432853:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790100567.432864:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+16:17177:x1877056141032320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100567.432877:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100567.432890:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287e65 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100567.432912:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100567.432932:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100567.432940:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083927000, rc 0) 00000100:00100000:2.0:1790100567.433215:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141032320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 351us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100567.433222:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790100567.433324:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100567.433357:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100567.433368:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100567.433429:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100567.433462:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100567.433491:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261908c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100567.433768:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141032448 00000100:00100000:2.0:1790100567.433773:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141032448 00000100:00100000:2.0:1790100567.433813:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790100567.433822:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141032448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100567.433934:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141032448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100567.433941:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790100567.434434:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084c13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100567.434471:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100567.434512:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100567.434544:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ed2240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100567.434878:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141032576 00000100:00100000:1.0:1790100567.434885:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141032576 00000100:00100000:1.0:1790100567.434946:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790100567.434955:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141032576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100567.435192:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141032576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100567.435200:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100567.435242:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100567.437489:0:18436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790100567.447740:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790100567.447777:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100567.447788:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.447799:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100567.447809:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100567.447811:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926184c6f000 from 13 10000000:01000000:0.0:1790100567.447814:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100567.447865:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.447872:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.447884:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100567.447908:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100567.447967:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100567.448003:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ed2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100567.448035:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141032704 00000100:00100000:0.0:1790100567.448042:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141032704 00000100:00100000:0.0:1790100567.448081:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790100567.448089:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+17:17177:x1877056141032704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100567.448100:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100567.448111:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287e73 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.448131:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 18 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.448140:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 18 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.448148:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565c200, rc 0) 00000100:00100000:0.0:1790100567.448195:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:17177:x1877056141032704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100567.448201:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790100567.448252:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100567.448265:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.448273:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100567.448322:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100567.448358:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100567.448376:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ed2240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100567.449086:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141032832 00000100:00100000:1.0:1790100567.449094:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141032832 00000100:00100000:1.0:1790100567.449127:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790100567.449135:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:17177:x1877056141032832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100567.449290:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:17177:x1877056141032832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100567.449297:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790100567.449422:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100567.449457:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100567.449502:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100567.449523:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083c65000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100567.450171:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141032960 00000100:00100000:1.0:1790100567.450178:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141032960 00000100:00100000:1.0:1790100567.450218:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790100567.450235:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+18:17177:x1877056141032960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100567.450329:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+18:17177:x1877056141032960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100567.450355:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790100567.450511:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141032960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790100567.461037:0:18437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790100567.466213:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790100567.466252:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100567.466264:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100567.466295:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.817118:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100568.529892:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100568.529899:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100568.529902:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100568.529905:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100568.529928:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100568.529931:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100568.529933:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100568.529936:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790100568.530111:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141033088:0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100568.530224:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141033600:0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530250:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100568.530274:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100568.530280:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141033216:0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100568.530391:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141033344:0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100568.530443:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100568.530449:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141033472:0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530471:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100568.530503:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141033088 00000100:00100000:1.0:1790100568.530510:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141033088 00000100:00100000:1.0:1790100568.530560:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790100568.530569:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+18:3641:x1877056141033088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530617:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+18:3641:x1877056141033088:12345-0@lo:400:kworker.0 Request processed in 49us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100568.530623:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790100568.530651:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141033600 00000100:00100000:1.0:1790100568.530655:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141033600 00000100:00100000:1.0:1790100568.530677:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141033344 00000100:00100000:1.0:1790100568.530693:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141033344 00000100:00100000:1.0:1790100568.530709:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100568.530715:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530747:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141033600:12345-0@lo:400:kworker.0 Request processed in 31us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100568.530753:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100568.530764:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100568.530770:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141033344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530802:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141033344:12345-0@lo:400:kworker.0 Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100568.530808:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100568.530826:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141033216 00000100:00100000:1.0:1790100568.530829:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141033216 00000100:00100000:1.0:1790100568.530851:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141033472 00000100:00100000:1.0:1790100568.530853:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141033472 00000100:00100000:1.0:1790100568.530865:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100568.530871:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056141033216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530902:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1877056141033216:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100568.530908:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100568.530919:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790100568.530925:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141033472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.530950:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141033472:12345-0@lo:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100568.530956:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790100568.531016:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100568.531024:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141033856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100568.531056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100568.531103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141033472:0@lo:400:kworker.0 00010000:00080000:1.0:1790100568.531116:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926083287100 x1877056141033344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100568.531126:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141033344:0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.531161:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141033856 00000100:00100000:1.0:1790100568.531164:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141033856 00000100:00100000:1.0:1790100568.531182:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790100568.531187:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1877056141033856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790100568.531208:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790100568.531241:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1877056141033856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100568.531247:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790100568.531274:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141033856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100568.531292:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141033216:0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.531299:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141033088:0@lo:400:kworker.0 00010000:00080000:1.0:1790100568.531308:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926083286300 x1877056141033600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100568.531317:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141033600:0@lo:400:kworker.0 00000100:00100000:1.0:1790100568.531327:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100568.531333:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141033728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100568.531372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100568.531393:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141033728 00000100:00100000:1.0:1790100568.531403:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141033728 00000100:00100000:1.0:1790100568.531424:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790100568.531429:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141033728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790100568.531445:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790100568.531475:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141033728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100568.531482:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790100568.531517:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141033728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100568.531791:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100558/real 1790100558] req@ffff9261a6256680 x1877056141027072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100568.531809:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9261a6256680 x1877056141027072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100568.531819:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100558/real 1790100558] req@ffff9261a6255880 x1877056141026816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100568.531831:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9261a6255880 x1877056141026816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790100568.531843:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790100568.531897:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790100568.531901:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141027072:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790100568.531907:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a62f9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100568.533035:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100568.533043:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100568.533045:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100568.533048:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100568.533052:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100568.533055:0:17873:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790100568.533058:0:17873:0:(import.c:65:import_set_state_nolock()) ffff9261a62f9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100568.533063:0:17873:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 409 00000100:00080000:0.0:1790100568.533068:0:17873:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790100568.533077:0:17873:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9261a62f9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100568.533104:0:17873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6257b80 x1877056141033984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100568.533119:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100568.533121:0:17873:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790100568.533131:0:17873:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100568.533134:0:17873:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 409 00000100:00080000:0.0:1790100568.533137:0:17873:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790100568.533141:0:17873:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff926083b6a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100568.533164:0:17873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6254a80 x1877056141034112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100568.533843:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790100568.533849:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141026816:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1790100568.533876:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141033984:0@lo:8:kworker.0 00000400:00000100:1.0:1790100568.533929:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141033984 offset 0 length 520: 4 00000100:00100000:1.0:1790100568.533960:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141034112:0@lo:8:kworker.0 00000400:00000100:1.0:1790100568.533978:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141034112 offset 0 length 520: 4 00000100:00080000:0.0:1790100568.534043:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100568.534048:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100568.534050:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100568.534052:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790100568.842466:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790100569.547508:0:17913:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790100569.547623:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100554/real 1790100554] req@ffff926083c55180 x1877056141024896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100569 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100569.547648:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff926083c55180 x1877056141024896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100569 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100569.547659:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100554/real 1790100554] req@ffff926083c56680 x1877056141025024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100569 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100569.547671:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff926083c56680 x1877056141025024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100569 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790100569.547697:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a24c3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100569.547717:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790100569.547721:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141024896:0@lo:8:kworker.0 00000100:00080000:0.0:1790100569.547726:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2023000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100569.547731:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790100569.547744:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141025024:0@lo:8:kworker.0 00000100:00080000:3.0:1790100569.550721:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100569.550727:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790100569.550731:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261a24c3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790100569.550739:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 405 00000100:00080000:3.0:1790100569.550751:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790100569.550763:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9261a24c3000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100569.550784:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083285f80 x1877056141034496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100569.550930:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141034240:0@lo:400:kworker.0 00000100:00100000:0.0:1790100569.550994:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100569.551045:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100569.551052:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141034368:0@lo:400:kworker.0 00000100:00100000:0.0:1790100569.551093:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100569.551125:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141034240 00000100:00100000:0.0:1790100569.551132:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141034240 00000100:00100000:0.0:1790100569.551185:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100569.551193:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:3644:x1877056141034240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100569.551238:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:3644:x1877056141034240:12345-0@lo:400:kworker.0 Request processed in 46us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100569.551245:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100569.551275:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141034368 00000100:00100000:0.0:1790100569.551279:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141034368 00000100:00100000:0.0:1790100569.551305:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790100569.551311:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141034368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100569.551369:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141034368:12345-0@lo:400:kworker.0 Request processed in 58us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100569.551376:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790100569.551533:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141034368:0@lo:400:kworker.0 00000100:00100000:0.0:1790100569.551559:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141034240:0@lo:400:kworker.0 00000100:00080000:3.0:1790100569.551638:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100569.551641:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790100569.551643:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261b2023000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790100569.551647:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 405 00000100:00080000:3.0:1790100569.551650:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790100569.551656:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9261b2023000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100569.551671:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083285880 x1877056141034624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790100569.551711:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100569.551714:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100569.551717:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100569.551720:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790100569.551740:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100569.551748:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141034752:0@lo:400:kworker.0 00000100:00100000:3.0:1790100569.551783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100569.551931:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141034752 00000100:00100000:3.0:1790100569.551936:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141034752 00000100:00100000:3.0:1790100569.551965:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100569.551971:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141034752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100569.552006:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141034752:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100569.552021:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790100569.552053:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926083287b80 x1877056141034752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100569.552063:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141034752:0@lo:400:kworker.0 00000100:00100000:2.0:1790100569.552301:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141034880:0@lo:400:kworker.0 00000100:00100000:2.0:1790100569.552333:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100569.552369:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100569.552375:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056141035008:0@lo:400:kworker.0 00000100:00100000:2.0:1790100569.552417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100569.552443:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141034880 00000100:00100000:2.0:1790100569.552447:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141034880 00000100:00100000:2.0:1790100569.552471:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100569.552478:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141034880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100569.552513:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141034880:12345-0@lo:400:kworker.0 Request processed in 35us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100569.552519:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100569.552538:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141035008 00000100:00100000:2.0:1790100569.552541:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141035008 00000100:00100000:2.0:1790100569.552562:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100569.552569:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056141035008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100569.552597:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1877056141035008:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100569.552603:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790100569.552627:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff926083287800 x1877056141035008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100569.552636:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1877056141035008:0@lo:400:kworker.0 00000100:00100000:2.0:1790100569.552644:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141034880:0@lo:400:kworker.0 00000100:00100000:0.0:1790100569.552832:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141034496:0@lo:8:kworker.0 00000400:00000100:0.0:1790100569.552858:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141034496 offset 0 length 520: 4 00000100:00100000:0.0:1790100569.552881:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141034624:0@lo:8:kworker.0 00000400:00000100:0.0:1790100569.552918:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056141034624 offset 0 length 520: 4 00010000:00010000:2.0:1790100569.864808:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100570.441853:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790100570.889418:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790100571.526827:0:18682:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790100571.526831:0:18682:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790100571.526832:0:18682:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790100571.526938:0:18682:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9261b230b800 00000020:01000004:2.0:1790100571.526953:0:18682:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790100571.526966:0:18682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790100571.526978:0:18682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9261a6940000) 00000020:00000080:2.0:1790100571.527133:0:18682:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790100571.581668:0:18682:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790100571.589036:0:18682:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1790100571.589312:0:18682:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790100571.589757:0:18682:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790100571.590850:0:18682:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1790100571.591476:0:18682:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790100571.591819:0:18682:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1790100571.592948:0:18682:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790100571.593547:0:18682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790100571.593558:0:18682:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790100571.593569:0:18682:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc87a4f2298287e88 00000020:01000004:3.0:1790100571.593575:0:18682:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790100571.593594:0:18682:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790100571.593598:0:18682:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790100571.593603:0:18682:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790100571.593608:0:18682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790100571.593618:0:18682:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff926082964d40) 00000020:00000080:3.0:1790100571.593628:0:18682:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1790100571.595841:0:18682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100571.596055:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790100571.596072:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790100571.596717:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790100571.596724:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790100571.597225:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790100571.597231:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790100571.601562:0:18682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100571.601751:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790100571.601758:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790100571.604136:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790100571.604148:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790100571.617785:0:18682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100571.618021:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790100571.618027:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790100571.619199:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790100571.619208:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790100571.619909:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790100571.619916:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790100571.621785:0:18682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100571.621965:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790100571.621971:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790100571.623050:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790100571.623057:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790100571.646567:0:18682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100571.646744:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790100571.646750:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790100571.647741:0:18682:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790100571.647749:0:18682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790100571.648081:0:18682:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790100571.648109:0:18682:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1790100571.648115:0:18682:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790100571.657194:0:18682:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100571.657257:0:18682:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790100571.657262:0:18682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100571.657264:0:18682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100571.657265:0:18682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100571.657266:0:18682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100571.657268:0:18682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100571.657269:0:18682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100571.657270:0:18682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100571.657272:0:18682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100571.657273:0:18682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100571.657276:0:18682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790100571.657278:0:18682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100571.657279:0:18682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100571.657280:0:18682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100571.657281:0:18682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100571.657282:0:18682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100571.657283:0:18682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100571.657284:0:18682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100571.657285:0:18682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100571.657286:0:18682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100571.657309:0:18682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790100571.657332:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790100571.657475:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.657555:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100571.657592:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141035136 00000100:00100000:1.0:1790100571.657599:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141035136 00000100:00100000:1.0:1790100571.657674:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790100571.657684:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:18682:x1877056141035136:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790100571.657717:0:17175:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790100571.657720:0:17175:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790100571.657724:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790100571.657994:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+18:18682:x1877056141035136:12345-0@lo:253:mount.lustre.0 Request processed in 310us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100571.658002:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790100571.658071:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790100571.658081:0:18682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790100571.658082:0:18682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790100571.658084:0:18682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100571.658085:0:18682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100571.658086:0:18682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100571.658087:0:18682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100571.658088:0:18682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100571.658089:0:18682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100571.658090:0:18682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100571.658091:0:18682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790100571.658104:0:18682:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9261b230b800 from lustre-OST0000 10000000:01000000:2.0:1790100571.658137:0:18682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790100571.658140:0:18682:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790100571.658147:0:18682:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9261b79fcd40 local copy 00010000:00010000:2.0:1790100571.658155:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100571.658222:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100571.658246:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.658816:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100571.658891:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141035264 00000100:00100000:0.0:1790100571.658896:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141035264 00000100:00100000:0.0:1790100571.658924:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790100571.658930:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:18682:x1877056141035264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100571.659000:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:18682:x1877056141035264:12345-0@lo:501:mount.lustre.0 Request processed in 69us (752us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100571.659006:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790100571.659080:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035264:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790100571.659093:0:18682:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790100571.659109:0:18682:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790100571.659115:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100571.659147:0:18682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100571.659173:0:18682:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9261b230b800 10000000:01000000:2.0:1790100571.659177:0:18682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790100571.659182:0:18682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790100571.659184:0:18682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790100571.659188:0:18682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790100571.659190:0:18682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790100571.659210:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083926400/0xc87a4f2298287e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100571.659218:0:18682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083926400/0xc87a4f2298287e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100571.659226:0:18682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083926400/0xc87a4f2298287e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100571.659238:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790100571.659261:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.659282:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100571.659371:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141035392 00000100:00100000:0.0:1790100571.659375:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141035392 00000100:00100000:0.0:1790100571.659391:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790100571.659397:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+18:18682:x1877056141035392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100571.659404:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100571.659414:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565c800/0xc87a4f2298287e9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287e96 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.659432:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565c800/0xc87a4f2298287e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287e96 expref: 19 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.659441:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565c800/0xc87a4f2298287e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e96 expref: 19 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.659449:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565c800, rc 0) 00000100:00100000:0.0:1790100571.659477:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035392:12345-0@lo:101:mount.lustre.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.659482:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790100571.659556:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100571.659567:0:18682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083926400/0xc87a4f2298287e96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e9d expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100571.659576:0:18682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083926400/0xc87a4f2298287e96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287e9d expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100571.660394:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790100571.660862:0:18682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100571.662629:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1790100571.662677:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1790100571.662690:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1790100571.662701:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1790100571.662713:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1790100571.662724:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1790100571.662744:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1790100571.662749:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1790100571.662845:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100571.662906:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.662947:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100571.663011:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141035520 00000100:00100000:0.0:1790100571.663023:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141035520 00000100:00100000:0.0:1790100571.663072:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790100571.663081:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100571.663214:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035520:12345-0@lo:501:mount.lustre.0 Request processed in 134us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.663221:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790100571.663410:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100571.663440:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100571.663473:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.663488:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100571.663530:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141035648 00000100:00100000:0.0:1790100571.663534:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141035648 00000100:00100000:0.0:1790100571.663591:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790100571.663597:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100571.664174:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035648:12345-0@lo:503:mount.lustre.0 Request processed in 575us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.664181:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790100571.664255:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790100571.664606:0:18682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790100571.664666:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100571.664703:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.664868:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100571.664911:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141035776 00000100:00100000:3.0:1790100571.664917:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141035776 00000100:00100000:3.0:1790100571.664942:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790100571.664949:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100571.665330:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035776:12345-0@lo:502:mount.lustre.0 Request processed in 380us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.665368:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790100571.665494:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790100571.665646:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790100571.665673:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790100571.665693:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790100571.665705:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790100571.665716:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790100571.665727:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790100571.665739:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790100571.665750:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790100571.665761:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1790100571.665775:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1790100571.665788:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1790100571.665800:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1790100571.665823:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100571.665860:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.665879:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100571.665931:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141035904 00000100:00100000:3.0:1790100571.665936:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141035904 00000100:00100000:3.0:1790100571.665955:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790100571.665961:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100571.666031:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141035904:12345-0@lo:502:mount.lustre.0 Request processed in 70us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.666038:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790100571.666167:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141035904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790100571.666201:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1790100571.666207:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1790100571.666709:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790100571.666717:0:18699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1790100571.666723:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100571.666725:0:18699:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790100571.666729:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790100571.666743:0:18699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9261a69419c0) 00000020:00000080:2.0:1790100571.666763:0:18699:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790100571.666769:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790100571.666842:0:18699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261b230b800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790100571.666850:0:18699:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790100571.666863:0:18699:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc87a4f2298287eab 00010000:00010000:2.0:1790100571.670516:0:18699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1790100571.670919:0:18699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1790100571.671997:0:18699:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1790100571.673245:0:18699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790100571.673259:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100571.673265:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100571.673267:0:18699:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790100571.673270:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790100571.673273:0:18699:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1790100571.673275:0:18699:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790100571.673276:0:18699:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790100571.673278:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790100571.673280:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100571.673282:0:18699:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790100571.673284:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100571.673287:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100571.673288:0:18699:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790100571.673290:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790100571.673293:0:18699:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790100571.673295:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100571.673296:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100571.673298:0:18699:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790100571.673300:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100571.673302:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100571.673303:0:18699:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790100571.673306:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790100571.673327:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100571.673329:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100571.673331:0:18699:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790100571.673333:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1790100571.673608:0:18682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790100571.673635:0:18682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790100571.673661:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083926400/0xc87a4f2298287e96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e9d expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.673673:0:18682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083926400/0xc87a4f2298287e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287e9d expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100571.673681:0:18682:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b230b800 from 1 10000000:01000000:3.0:1790100571.673684:0:18682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100571.673715:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.673723:0:18682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.673733:0:18682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100571.673755:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100571.673817:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100571.673858:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261c1906c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100571.673947:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141036032 00000100:00100000:2.0:1790100571.673954:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141036032 00000100:00100000:2.0:1790100571.673995:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790100571.674004:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+19:18682:x1877056141036032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100571.674015:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100571.674025:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287eb2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100571.674057:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 20 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100571.674076:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 20 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100571.674085:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926800, rc 0) 00000100:00100000:2.0:1790100571.674135:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036032:12345-0@lo:101:mount.lustre.0 Request processed in 123us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100571.674141:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790100571.674286:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100571.674299:0:18682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.674308:0:18682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790100571.675196:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790100571.675421:0:18682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100571.675578:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790100571.675605:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790100571.675620:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790100571.675625:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790100571.675677:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100571.675720:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100571.675865:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261c1906cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100571.677168:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141036160 00000100:00100000:1.0:1790100571.677179:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141036160 00000100:00100000:1.0:1790100571.679821:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790100571.679838:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100571.679995:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036160:12345-0@lo:501:mount.lustre.0 Request processed in 163us (4273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100571.680002:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790100571.681701:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100571.681754:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100571.681816:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.681973:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082bf5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100571.682001:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141036288 00000100:00100000:2.0:1790100571.682006:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141036288 00000100:00100000:2.0:1790100571.682042:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790100571.682049:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100571.682214:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036288:12345-0@lo:503:mount.lustre.0 Request processed in 164us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100571.682222:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790100571.682299:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790100571.682681:0:18682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100571.682757:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100571.682794:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.682811:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082bf5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100571.682870:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141036416 00000100:00100000:2.0:1790100571.682874:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141036416 00000100:00100000:2.0:1790100571.682894:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790100571.682901:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100571.682982:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036416:12345-0@lo:502:mount.lustre.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100571.682989:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790100571.683053:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790100571.683289:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790100571.683311:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790100571.683331:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790100571.683372:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790100571.683386:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790100571.683398:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790100571.683409:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790100571.683421:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1790100571.683432:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790100571.683444:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1790100571.683455:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1790100571.683474:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100571.683506:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.683529:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082bf5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100571.683602:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141036544 00000100:00100000:3.0:1790100571.683607:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141036544 00000100:00100000:3.0:1790100571.683626:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790100571.683632:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100571.683701:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036544:12345-0@lo:502:mount.lustre.0 Request processed in 68us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.683707:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790100571.683783:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790100571.683820:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1790100571.683827:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790100571.684510:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100571.684519:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100571.684521:0:18703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790100571.684529:0:18703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261b230b800 00000020:00000080:3.0:1790100571.684531:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100571.684538:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100571.684541:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100571.684542:0:18703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790100571.684545:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100571.684547:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100571.684548:0:18703:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790100571.684551:0:18703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9261b230b800 00000020:00000080:3.0:1790100571.684554:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100571.684633:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100571.684636:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100571.684638:0:18703:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790100571.684640:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100571.684643:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100571.684651:0:18703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790100571.684655:0:18703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261b230b800 00000020:00000080:3.0:1790100571.684657:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100571.690604:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100571.690616:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100571.690618:0:18703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790100571.690623:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100571.690627:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100571.690628:0:18703:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790100571.690633:0:18703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9261b230b800 00000020:00000080:3.0:1790100571.690635:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100571.690689:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100571.690691:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100571.690693:0:18703:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790100571.690696:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1790100571.690757:0:18682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790100571.690787:0:18682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100571.695298:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.695316:0:18682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100571.695390:0:18682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790100571.695393:0:18682:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9261b230b800 10000000:01000000:3.0:1790100571.695396:0:18682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9261b230b800 10000000:01000000:3.0:1790100571.695399:0:18682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790100571.695405:0:18682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9261b230b800 from 1 10000000:01000000:3.0:1790100571.695407:0:18682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790100571.695439:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6000/0xc87a4f2298287ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.695458:0:18682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b6000/0xc87a4f2298287ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.695469:0:18682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b6000/0xc87a4f2298287ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100571.695493:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100571.695550:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100571.695585:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261c1906c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100571.695610:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141036672 00000100:00100000:3.0:1790100571.695616:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141036672 00000100:00100000:3.0:1790100571.695652:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790100571.695659:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+20:18682:x1877056141036672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100571.695670:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100571.695681:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7600/0xc87a4f2298287ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287ec0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.695701:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7600/0xc87a4f2298287ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287ec0 expref: 21 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.695711:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7600/0xc87a4f2298287ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287ec0 expref: 21 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.695719:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7600, rc 0) 00000100:00100000:3.0:1790100571.695751:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141036672:12345-0@lo:101:mount.lustre.0 Request processed in 93us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.695757:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790100571.695807:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100571.695821:0:18682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b6000/0xc87a4f2298287ec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287ec7 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100571.695830:0:18682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6000/0xc87a4f2298287ec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287ec7 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790100571.697854:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790100571.698173:0:18682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100571.698361:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790100571.698395:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790100571.698408:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790100571.698420:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790100571.698432:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790100571.698443:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790100571.698454:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790100571.698465:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790100571.698476:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790100571.698488:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790100571.698499:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790100571.698510:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790100571.698521:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790100571.698532:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790100571.698543:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790100571.698554:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790100571.698565:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790100571.698586:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790100571.698599:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790100571.698610:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790100571.698621:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790100571.698632:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790100571.698643:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790100571.698663:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790100571.698674:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1790100571.698686:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1790100571.698697:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1790100571.698707:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1790100571.698719:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1790100571.698730:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1790100571.698741:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1790100571.698752:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1790100571.698765:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1790100571.698792:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1790100571.698807:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1790100571.698820:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1790100571.698834:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1790100571.698852:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1790100571.698857:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790100571.698935:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100571.698992:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100571.699024:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182447240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100571.701166:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141036800 00000100:00100000:1.0:1790100571.701180:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141036800 00000100:00100000:1.0:1790100571.701234:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790100571.701243:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141036800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100571.701410:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141036800:12345-0@lo:501:mount.lustre.0 Request processed in 168us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100571.701429:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790100571.702210:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100571.702255:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100571.702300:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100571.702328:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141036928 00000100:00100000:3.0:1790100571.702332:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141036928 00000100:00100000:3.0:1790100571.702379:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790100571.702385:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141036928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100571.702470:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141036928:12345-0@lo:503:mount.lustre.0 Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.702477:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790100571.702516:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff926182447240 going to sleep for 11 seconds 00000100:00100000:3.0:1790100571.702527:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141036928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790100571.702867:0:18682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100571.702926:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141037056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100571.702959:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100571.702980:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141037056 00000100:00100000:3.0:1790100571.702983:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141037056 00000100:00100000:3.0:1790100571.703002:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790100571.703008:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141037056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100571.703415:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261c1906c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100571.705925:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141037056:12345-0@lo:502:mount.lustre.0 Request processed in 2909us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.705937:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790100571.710208:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141037056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790100571.710534:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790100571.710564:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790100571.710575:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790100571.710586:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790100571.710598:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790100571.710609:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790100571.710620:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790100571.710632:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790100571.710643:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790100571.710654:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790100571.710666:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790100571.710677:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790100571.710688:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790100571.710699:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790100571.710710:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790100571.710722:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790100571.710733:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790100571.710744:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790100571.710755:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790100571.710769:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790100571.710783:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790100571.710796:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790100571.710809:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790100571.710822:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790100571.710851:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1790100571.710864:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1790100571.710875:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1790100571.710889:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1790100571.710901:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1790100571.710913:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1790100571.710924:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1790100571.710935:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1790100571.710955:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1790100571.710966:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1790100571.710977:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1790100571.710988:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1790100571.710998:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1790100571.711009:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1790100571.711020:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1790100571.711031:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1790100571.711053:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1790100571.711065:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1790100571.711076:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1790100571.711087:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1790100571.711098:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1790100571.711109:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1790100571.711120:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1790100571.713481:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1790100571.713540:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141037184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100571.713609:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.713648:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261909a1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100571.713726:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141037184 00000100:00100000:3.0:1790100571.713733:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141037184 00000100:00100000:3.0:1790100571.713814:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100571.713824:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141037184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100571.713928:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141037184:12345-0@lo:502:mount.lustre.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.713935:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790100571.716464:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141037184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790100571.716678:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1790100571.716702:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1790100571.716737:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141037312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100571.716801:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.718149:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261c1906c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100571.718246:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141037312 00000100:00100000:1.0:1790100571.718254:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141037312 00000100:00100000:1.0:1790100571.718309:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790100571.718317:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141037312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100571.718455:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141037312:12345-0@lo:502:mount.lustre.0 Request processed in 138us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100571.718463:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790100571.718558:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141037312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790100571.718621:0:18682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1790100571.718631:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790100571.720814:0:18709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790100571.720833:0:18709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9261b5ab19c0) 00000020:00000080:0.0:1790100571.720856:0:18709:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1790100571.720943:0:18709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261b230b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790100571.720948:0:18709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261b230b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790100571.720950:0:18709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b230b800 3 00010000:00080000:0.0:1790100571.720975:0:18709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff926083d08000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790100571.723981:0:18709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1790100571.726283:0:18709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790100571.726327:0:18709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790100571.726372:0:18709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc87a4f2298287ed5 00000100:00080000:0.0:1790100571.726382:0:18709:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100571.726392:0:18709:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff926083d08000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100571.726424:0:18709:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6257800 x1877056141037440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100571.726470:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056141037440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790100571.726526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790100571.726576:0:18709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790100571.726617:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100571.726621:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100571.726624:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100571.726626:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100571.726648:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100571.726651:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100571.726653:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100571.726655:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790100571.726677:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056141037696:0@lo:400:kworker.0 00000100:00100000:0.0:1790100571.726701:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.726716:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100571.726721:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141037568:0@lo:400:kworker.0 00000100:00100000:0.0:1790100571.726741:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.726764:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056141037952:0@lo:400:kworker.0 00000100:00100000:0.0:1790100571.726788:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.726802:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100571.726807:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141037824:0@lo:400:kworker.0 00000100:00100000:0.0:1790100571.726841:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.726869:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141037568 00000100:00100000:0.0:1790100571.726880:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141037568 00000100:00100000:0.0:1790100571.726911:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141037824 00000100:00100000:0.0:1790100571.726913:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141037824 00000100:00100000:0.0:1790100571.726926:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100571.726933:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141037568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100571.726977:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141037568:12345-0@lo:400:kworker.0 Request processed in 44us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.726984:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100571.726997:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100571.727002:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141037824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100571.727025:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141037824:12345-0@lo:400:kworker.0 Request processed in 23us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.727031:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790100571.727467:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141037440 00000100:00100000:2.0:1790100571.727478:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141037440 00000100:00100000:2.0:1790100571.727491:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141037696 00000100:00100000:2.0:1790100571.727493:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141037696 00000100:00100000:2.0:1790100571.727507:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141037952 00000100:00100000:2.0:1790100571.727509:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141037952 00000100:00100000:2.0:1790100571.727521:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100571.727527:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056141037696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100571.727561:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056141037696:12345-0@lo:400:kworker.0 Request processed in 34us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100571.727566:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100571.727578:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790100571.727583:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056141037952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100571.727603:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056141037952:12345-0@lo:400:kworker.0 Request processed in 20us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100571.727608:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790100571.727617:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100571.727620:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877056141037440:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790100571.727639:0:17182:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:2.0:1790100571.727666:0:17182:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc87a4f2298287edc 00000004:00100000:2.0:1790100571.727679:0:17182:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790100571.727702:0:17182:0:(import.c:65:import_set_state_nolock()) ffff926083d4e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100571.727736:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877056141037440:12345-0@lo:38:llog_process_th.0 Request processed in 114us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100571.727742:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790100571.727781:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9261a6257800 x1877056141037440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100571.727791:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790100571.727803:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790100571.727809:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790100571.727814:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790100571.727816:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083d08000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790100571.727822:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1877056141037440:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1790100571.731248:0:18709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790100571.731264:0:18709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9261868499c0) 00000020:00000080:1.0:1790100571.731285:0:18709:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1790100571.731370:0:18709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9261b230b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790100571.731374:0:18709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9261b230b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790100571.731376:0:18709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9261b230b800 3 00010000:00080000:1.0:1790100571.731402:0:18709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff926083d0a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790100571.732911:0:18709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:0.0:1790100571.733171:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141037568:0@lo:400:kworker.0 00010000:00080000:0.0:1790100571.733208:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9261a6256a00 x1877056141037696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100571.733221:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056141037696:0@lo:400:kworker.0 00000100:00100000:0.0:1790100571.733277:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141037824:0@lo:400:kworker.0 00010000:00080000:0.0:1790100571.733288:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9261a6255c00 x1877056141037952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100571.733297:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056141037952:0@lo:400:kworker.0 00000020:00000080:1.0:1790100571.734190:0:18709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1790100571.735310:0:18709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790100571.735322:0:18709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc87a4f2298287eea 00000100:00080000:0.0:1790100571.735332:0:18709:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100571.735361:0:18709:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff926083d0a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100571.735396:0:18709:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6255c00 x1877056141038080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100571.735414:0:18709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790100571.735435:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100571.735439:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100571.735441:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100571.735444:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100571.735447:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100571.735450:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100571.735453:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100571.735455:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1790100571.735719:0:18709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1790100571.735854:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1877056141038080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790100571.735919:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1790100571.735968:0:18682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790100571.735997:0:18682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790100571.736018:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6000/0xc87a4f2298287ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287ec7 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100571.736029:0:18682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b6000/0xc87a4f2298287ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287ec7 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790100571.736170:0:18682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790100571.736172:0:18682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100571.736173:0:18682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100571.736175:0:18682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100571.736176:0:18682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100571.736177:0:18682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100571.736178:0:18682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100571.736180:0:18682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100571.736182:0:18682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790100571.736185:0:18682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790100571.736188:0:18682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100571.736189:0:18682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100571.736190:0:18682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100571.736191:0:18682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100571.736192:0:18682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100571.736194:0:18682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100571.736194:0:18682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100571.736200:0:18682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100571.736201:0:18682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790100571.736216:0:18682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790100571.736227:0:18682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141038208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790100571.736257:0:18682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100571.736277:0:18682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261c1906180 going to sleep for 11 seconds 00000100:00100000:2.0:1790100571.736296:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141038080 00000100:00100000:2.0:1790100571.736301:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141038080 00000100:00100000:2.0:1790100571.736329:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100571.736335:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877056141038080:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790100571.736381:0:17182:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:2.0:1790100571.736421:0:17182:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc87a4f2298287ef1 00000004:00100000:2.0:1790100571.736432:0:17182:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790100571.736457:0:17182:0:(import.c:65:import_set_state_nolock()) ffff926083d4f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100571.736498:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877056141038080:12345-0@lo:38:llog_process_th.0 Request processed in 162us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100571.736505:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790100571.736539:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9261a6255c00 x1877056141038080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100571.736547:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790100571.736554:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790100571.736561:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790100571.736564:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790100571.736566:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083d0a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790100571.736571:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1877056141038080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790100571.736659:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141038208 00000100:00100000:1.0:1790100571.736663:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141038208 00000100:00100000:1.0:1790100571.736722:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790100571.736728:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141038208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790100571.736746:0:17173:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790100571.736757:0:17173:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790100571.749115:0:17173:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790100571.749165:0:17173:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790100571.749445:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:18682:x1877056141038208:12345-0@lo:253:mount.lustre.0 Request processed in 12712us (13182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100571.749457:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790100571.749566:0:18682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:18682:1877056141038208:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790100571.749579:0:18682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790100571.749582:0:18682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100571.749583:0:18682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790100571.749585:0:18682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100571.749586:0:18682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100571.749588:0:18682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100571.749589:0:18682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100571.749591:0:18682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100571.749597:0:18682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100571.749598:0:18682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790100571.749610:0:18682:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1790100571.750984:0:18682:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 20000000:01000000:0.0:1790100571.752969:0:17196:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790100571.752977:0:17196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790100571.752998:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753017:0:17196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 20 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753025:0:17196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 20 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753032:0:17196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753078:0:17196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 20 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753101:0:17196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 20 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100571.753116:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141038336:0@lo:104: 00000100:00100000:0.0:1790100571.753185:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100571.753227:0:17196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 20 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753237:0:17196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 20 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100571.753245:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141038464:0@lo:104: 00000100:00100000:0.0:1790100571.753266:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.753280:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccec00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100571.753304:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790100571.753318:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141038336 00000100:00100000:0.0:1790100571.753325:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141038336 00000100:00100000:0.0:1790100571.753371:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141038464 00000100:00100000:0.0:1790100571.753374:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141038464 00000100:00100000:0.0:1790100571.753387:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100571.753393:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:687676b7-da9e-40a3-8051-3299bac6cf99+4:17196:x1877056141038336:12345-0@lo:104: 00010000:00010000:0.0:1790100571.753405:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753448:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100571.753454:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:687676b7-da9e-40a3-8051-3299bac6cf99+4:17196:x1877056141038336:12345-0@lo:104: Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.753461:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100571.753484:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100571.753489:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:687676b7-da9e-40a3-8051-3299bac6cf99+3:17196:x1877056141038464:12345-0@lo:104: 00010000:00010000:0.0:1790100571.753496:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753524:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790100571.753528:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:687676b7-da9e-40a3-8051-3299bac6cf99+3:17196:x1877056141038464:12345-0@lo:104: Request processed in 40us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.753534:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790100571.753564:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100571.753569:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753576:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100571.753580:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753588:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100571.753595:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100571.753601:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790100571.753625:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753631:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100571.753649:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753666:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565d200/0xc87a4f2298287e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e50 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753677:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100571.753681:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753686:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e200 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:0.0:1790100571.753689:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753696:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100571.753702:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100571.753707:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790100571.753717:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753722:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100571.753728:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753734:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926184b8e200/0xc87a4f2298287e3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e42 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753745:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100571.753751:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100571.753752:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100571.753763:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141038720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100571.753791:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.753810:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100571.753815:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141038592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100571.753837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.753861:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141038720 00000100:00100000:0.0:1790100571.753865:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141038720 00010000:00010000:0.0:1790100571.753881:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 21 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100571.753899:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141038592 00000100:00100000:0.0:1790100571.753902:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141038592 00010000:00010000:0.0:1790100571.753912:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 22 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100571.753927:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100571.753932:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+22:3642:x1877056141038720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100571.753940:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100571.753945:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 22 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753954:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 22 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.753967:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100571.753989:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+22:3642:x1877056141038720:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.753995:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100571.754012:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100571.754017:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261912abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+21:3642:x1877056141038592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100571.754024:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100571.754028:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 21 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754036:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 21 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754047:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754055:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790100571.754066:0:17166:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009187787s 00010000:00010000:0.0:1790100571.754070:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754077:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754084:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754090:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754095:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565de00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100571.754099:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754115:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754135:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754145:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100571.754166:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261912abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+21:3642:x1877056141038592:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.754172:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100571.754234:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141038592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100571.754242:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141038720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100571.754262:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926184b8f000/0xc87a4f2298287e50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287e49 expref: 20 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100571.754271:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141038336:0@lo:104: 00010000:00010000:0.0:1790100571.754279:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7200/0xc87a4f2298287e42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287e3b expref: 19 pid: 17173 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100571.754286:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141038464:0@lo:104: 00010000:00010000:0.0:1790100571.754296:0:17196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754304:0:17196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754310:0:17196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754322:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565de00/0xc87a4f2298287ef8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100571.754374:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790100571.754817:0:18682:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790100571.754822:0:18682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790100571.754855:0:18682:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790100571.754892:0:18682:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790100571.754910:0:18682:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790100571.754930:0:18682:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1790100571.755685:0:18682:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100571.756202:0:18682:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790100571.912696:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790100572.751877:0:18762:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790100572.752269:0:18762:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790100572.939868:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790100573.640574:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790100573.640582:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9261b5ae0000 from 9 10000000:01000000:0.0:1790100573.640587:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100573.640637:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100573.640650:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100573.640661:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100573.640687:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141038848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100573.640749:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100573.640793:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100573.640988:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141038848 00000100:00100000:3.0:1790100573.640996:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141038848 00000100:00100000:3.0:1790100573.641050:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790100573.641059:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+19:17177:x1877056141038848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100573.641070:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100573.641088:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287eff expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100573.641155:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287eff expref: 20 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100573.641167:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287eff expref: 20 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100573.641176:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7000, rc 0) 00000100:00100000:3.0:1790100573.641223:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+20:17177:x1877056141038848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100573.641233:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790100573.641553:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141039104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100573.641639:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100573.641824:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100573.641835:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141038976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100573.641871:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100573.641948:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141039104 00000100:00100000:1.0:1790100573.641954:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141039104 00000100:00100000:1.0:1790100573.641986:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141038976 00000100:00100000:1.0:1790100573.641989:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141038976 00000100:00100000:1.0:1790100573.642013:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790100573.642020:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141039104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790100573.642059:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790100573.642106:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141039104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100573.642121:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790100573.642135:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790100573.642141:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141038976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790100573.642156:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790100573.642181:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141038976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100573.642187:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790100573.642273:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141038976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100573.642285:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141039104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100573.642689:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141038848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100573.642707:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100573.642718:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100573.642775:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141039232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790100573.642807:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100573.642838:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100573.642890:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141039232 00000100:00100000:2.0:1790100573.642895:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141039232 00000100:00100000:2.0:1790100573.642928:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790100573.642947:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+20:17177:x1877056141039232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790100573.642965:0:17173:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790100573.642984:0:17173:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790100573.642987:0:17173:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790100573.643079:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+20:17177:x1877056141039232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100573.643086:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790100573.643187:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141039232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790100573.643244:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100573.643251:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100573.643259:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100573.643267:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790100573.643269:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926184c6f000 from 9 10000000:01000000:0.0:1790100573.643271:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100573.643292:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100573.643309:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100573.643317:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100573.643484:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141039360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100573.643528:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100573.643545:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100573.643652:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141039360 00000100:00100000:2.0:1790100573.643657:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141039360 00000100:00100000:2.0:1790100573.643695:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790100573.643702:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+20:17177:x1877056141039360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100573.643711:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100573.643727:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287f0d expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100573.643746:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100573.643755:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100573.643763:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083926a00, rc 0) 00000100:00100000:2.0:1790100573.643808:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141039360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100573.643816:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100573.643950:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141039360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100573.643967:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100573.643974:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100573.644013:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141039488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790100573.644042:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100573.644063:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8ccecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100573.644121:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141039488 00000100:00100000:2.0:1790100573.644125:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141039488 00000100:00100000:2.0:1790100573.644151:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790100573.644157:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141039488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790100573.644167:0:17175:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790100573.644179:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790100573.644181:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790100573.644255:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141039488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100573.644262:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790100573.644543:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141039488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790100573.644584:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100573.644589:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100573.644600:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100573.972293:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100574.984588:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100576.016134:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100576.523076:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790100577.032962:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100577.224464:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100577.224471:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100577.224473:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100577.224476:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100577.224500:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100577.224504:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100577.224506:0:17873:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100577.224520:0:17873:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790100577.224560:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141039744:0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.224626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100577.224674:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056141040256:0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.224696:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100577.224719:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790100577.224725:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141039616:0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.224752:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100577.224774:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056141040128:0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.224793:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100577.224816:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141039872:0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.224834:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100577.224848:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141040384:0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.224867:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100577.224875:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100577.224880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141040000:0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.224896:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100577.224926:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141040256 00000100:00100000:0.0:1790100577.224932:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141040256 00000100:00100000:0.0:1790100577.224968:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141040128 00000100:00100000:0.0:1790100577.224970:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141040128 00000100:00100000:0.0:1790100577.224979:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141039872 00000100:00100000:0.0:1790100577.224981:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141039872 00000100:00100000:0.0:1790100577.224989:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141040384 00000100:00100000:0.0:1790100577.224991:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141040384 00000100:00100000:0.0:1790100577.225003:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100577.225010:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056141040256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.225062:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056141040256:12345-0@lo:400:kworker.0 Request processed in 52us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100577.225069:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100577.225097:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100577.225103:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056141040128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.225132:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056141040128:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100577.225139:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100577.225153:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790100577.225158:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141039872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100577.225169:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141039744 00000100:00100000:1.0:1790100577.225176:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141039744 00000100:00100000:0.0:1790100577.225189:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141039872:12345-0@lo:400:kworker.0 Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100577.225196:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790100577.225209:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100577.225214:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141040000 00000100:00100000:0.0:1790100577.225219:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141040384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100577.225220:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141040000 00000100:00100000:1.0:1790100577.225250:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100577.225255:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141040384:12345-0@lo:400:kworker.0 Request processed in 37us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100577.225263:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141039744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.225266:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790100577.225287:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141039616 00000100:00100000:0.0:1790100577.225292:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141039616 00000100:00100000:1.0:1790100577.225319:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141039744:12345-0@lo:400:kworker.0 Request processed in 59us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100577.225320:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790100577.225330:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:3642:x1877056141039616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100577.225332:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790100577.225376:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790100577.225384:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:3642:x1877056141039616:12345-0@lo:400:kworker.0 Request processed in 54us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100577.225387:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141040000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100577.225396:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790100577.225430:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141040000:12345-0@lo:400:kworker.0 Request processed in 45us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100577.225437:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790100577.225473:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141040000:0@lo:400:kworker.0 00010000:00080000:0.0:1790100577.225488:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6256680 x1877056141039872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100577.225503:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141039872:0@lo:400:kworker.0 00000100:00100000:1.0:1790100577.225504:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141039616:0@lo:400:kworker.0 00010000:00080000:0.0:1790100577.225522:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6255f80 x1877056141040384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1790100577.225528:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6256300 x1877056141040128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100577.225536:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141040384:0@lo:400:kworker.0 00000100:00100000:1.0:1790100577.225547:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056141040128:0@lo:400:kworker.0 00000100:00100000:1.0:1790100577.225563:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141039744:0@lo:400:kworker.0 00010000:00080000:1.0:1790100577.225578:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6257100 x1877056141040256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100577.225586:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056141040256:0@lo:400:kworker.0 00000100:00080000:2.0:1790100577.228401:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100577.228410:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1790100577.996113:0:19052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790100578.061105:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100578.763925:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100578.763952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141040512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100578.764019:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100578.764061:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141040512 00000100:00100000:0.0:1790100578.764068:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141040512 00000100:00100000:0.0:1790100578.764114:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790100578.764122:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141040512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790100578.764166:0:17921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790100578.764205:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141040512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100578.764211:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790100578.764247:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141040512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100578.766908:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141040640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100578.766987:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100578.767265:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141040640 00000100:00100000:1.0:1790100578.767273:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141040640 00000100:00100000:1.0:1790100578.767325:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790100578.767334:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141040640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790100578.767391:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790100578.767438:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141040640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100578.767446:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790100578.767490:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141040640:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1790100578.932972:0:19104:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790100578.933316:0:19104:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790100579.090555:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790100579.821191:0:19154:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790100579.821804:0:19154:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790100580.108878:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790100580.685977:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790100581.131570:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100582.161596:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790100582.344571:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100582.344578:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100582.344580:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100582.344583:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100582.344600:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100582.344603:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100582.344605:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100582.344614:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790100582.344658:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141040896:0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.344724:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100582.344769:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056141041408:0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.344792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100582.344812:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790100582.344817:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141041024:0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.344835:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100582.344849:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141041536:0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.344866:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100582.344894:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141040896 00000100:00100000:2.0:1790100582.344901:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141040896 00000100:00100000:2.0:1790100582.344945:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100582.344964:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141040896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.345017:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141040896:12345-0@lo:400:kworker.0 Request processed in 64us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100582.345024:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100582.345076:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141040896:0@lo:400:kworker.0 00000100:00100000:0.0:1790100582.345153:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141041152:0@lo:400:kworker.0 00000100:00100000:0.0:1790100582.345188:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100582.345227:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790100582.345232:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141040768:0@lo:400:kworker.0 00000100:00100000:0.0:1790100582.345255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100582.345275:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141041280:0@lo:400:kworker.0 00000100:00100000:0.0:1790100582.345292:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100582.345311:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141041408 00000100:00100000:0.0:1790100582.345315:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141041408 00000100:00100000:0.0:1790100582.345366:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141041024 00000100:00100000:0.0:1790100582.345370:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141041024 00000100:00100000:0.0:1790100582.345380:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141041536 00000100:00100000:0.0:1790100582.345383:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141041536 00000100:00100000:0.0:1790100582.345393:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141041280 00000100:00100000:0.0:1790100582.345395:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141041280 00000100:00100000:0.0:1790100582.345406:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790100582.345412:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056141041408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100582.345445:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056141041408:12345-0@lo:400:kworker.0 Request processed in 32us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100582.345450:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790100582.345463:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100582.345468:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141041024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100582.345492:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141041024:12345-0@lo:400:kworker.0 Request processed in 24us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100582.345497:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100582.345508:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790100582.345513:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141041536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100582.345539:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141041536:12345-0@lo:400:kworker.0 Request processed in 27us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100582.345551:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790100582.345563:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100582.345569:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141041280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100582.345600:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141041280:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100582.345606:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1790100582.345636:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083c57800 x1877056141041280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100582.345648:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141041280:0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.349370:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141041152 00000100:00100000:2.0:1790100582.349384:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141041152 00000100:00100000:2.0:1790100582.349445:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100582.349455:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141041152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.349548:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141041152:12345-0@lo:400:kworker.0 Request processed in 95us (4358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100582.349554:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100582.349591:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141040768 00000100:00100000:2.0:1790100582.349595:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141040768 00000100:00100000:2.0:1790100582.349621:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790100582.349627:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:3641:x1877056141040768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.349660:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:3641:x1877056141040768:12345-0@lo:400:kworker.0 Request processed in 33us (4403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100582.349666:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1790100582.349692:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100582.349697:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100582.349734:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141040768:0@lo:400:kworker.0 00000100:00100000:2.0:1790100582.349748:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141041152:0@lo:400:kworker.0 00010000:00080000:2.0:1790100582.349783:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083c57480 x1877056141041024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100582.349794:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141041024:0@lo:400:kworker.0 00010000:00080000:2.0:1790100582.349805:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083c54e00 x1877056141041536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100582.349813:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141041536:0@lo:400:kworker.0 00010000:00080000:2.0:1790100582.349824:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083c57100 x1877056141041408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100582.349831:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056141041408:0@lo:400:kworker.0 00010000:00010000:1.0:1790100583.196052:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100583.880605:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141041664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100583.880673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100583.881407:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141041664 00000100:00100000:3.0:1790100583.881417:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141041664 00000100:00100000:3.0:1790100583.881469:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790100583.881479:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141041664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790100583.881523:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790100583.884900:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141041664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3403us (4206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100583.884914:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790100583.885456:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141041792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100583.885583:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100583.886070:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141041664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100583.886111:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141041792 00000100:00100000:2.0:1790100583.886119:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141041792 00000100:00100000:2.0:1790100583.886899:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790100583.886911:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141041792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100583.886954:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790100583.887017:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141041792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.887025:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790100583.890092:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141041792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100584.010121:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100568/real 1790100568] req@ffff9261a6257b80 x1877056141033984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100583 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100584.010149:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9261a6257b80 x1877056141033984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100583 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100584.010166:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100568/real 1790100568] req@ffff9261a6254a80 x1877056141034112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100583 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100584.010179:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9261a6254a80 x1877056141034112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100583 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790100584.010200:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a62f9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790100584.010225:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790100584.010229:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141033984:0@lo:8:kworker.0 00000100:00080000:1.0:1790100584.010235:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790100584.010240:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790100584.010243:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141034112:0@lo:8:kworker.0 00000100:00080000:2.0:1790100584.010386:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100584.010391:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100584.010394:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100584.010397:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790100584.010409:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100584.010412:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790100584.010414:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261a62f9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100584.010419:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 419 00000100:00080000:2.0:1790100584.010425:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790100584.010437:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9261a62f9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100584.010459:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a636b800 x1877056141042176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100584.010475:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790100584.010478:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790100584.010486:0:38:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100584.010489:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 419 00000100:00080000:2.0:1790100584.010492:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790100584.010497:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff926083b6a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790100584.010520:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9261a6369500 x1877056141042304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100584.010569:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056141042048:0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.010647:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100584.010681:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790100584.010688:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141041920:0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.010720:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100584.010746:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056141042688:0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.010768:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100584.010793:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141042432:0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.010813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100584.010830:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100584.010836:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141042560:0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.010853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100584.010876:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141042048 00000100:00100000:2.0:1790100584.010883:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141042048 00000100:00100000:2.0:1790100584.010920:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141042688 00000100:00100000:2.0:1790100584.010923:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141042688 00000100:00100000:2.0:1790100584.010945:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141042432 00000100:00100000:2.0:1790100584.010948:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141042432 00000100:00100000:2.0:1790100584.010958:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141042560 00000100:00100000:2.0:1790100584.010960:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141042560 00000100:00100000:2.0:1790100584.011728:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100584.011747:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056141042048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.011816:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1877056141042048:12345-0@lo:400:kworker.0 Request processed in 72us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100584.011823:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100584.011844:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100584.011852:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056141042688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.011880:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056141042688:12345-0@lo:400:kworker.0 Request processed in 29us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100584.011885:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100584.011896:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100584.011902:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141042432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.011933:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141042432:12345-0@lo:400:kworker.0 Request processed in 31us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100584.011938:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100584.011950:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100584.011956:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141042560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.012059:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141042560:12345-0@lo:400:kworker.0 Request processed in 103us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100584.012066:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100584.012089:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141041920 00000100:00100000:2.0:1790100584.012094:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141041920 00000100:00100000:2.0:1790100584.012123:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790100584.012129:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+21:3644:x1877056141041920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.012176:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+21:3644:x1877056141041920:12345-0@lo:400:kworker.0 Request processed in 47us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100584.012191:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1790100584.012227:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100584.012231:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790100584.012259:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6368380 x1877056141042560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100584.012272:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141042560:0@lo:400:kworker.0 00010000:00080000:2.0:1790100584.012283:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a636b100 x1877056141042432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100584.012291:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141042432:0@lo:400:kworker.0 00000100:00100000:2.0:1790100584.012319:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141042176:0@lo:8:kworker.0 00000100:00100000:2.0:1790100584.012365:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100584.012399:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141042304:0@lo:8:kworker.0 00000100:00100000:2.0:1790100584.012420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100584.012451:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141041920:0@lo:400:kworker.0 00010000:00080000:2.0:1790100584.012463:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6369180 x1877056141042688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100584.012471:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056141042688:0@lo:400:kworker.0 00010000:00080000:2.0:1790100584.012480:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a6368000 x1877056141042048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100584.012488:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1877056141042048:0@lo:400:kworker.0 00000100:00100000:0.0:1790100584.012824:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141042176 00000100:00100000:0.0:1790100584.012829:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141042176 00000100:00100000:0.0:1790100584.012857:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141042304 00000100:00100000:0.0:1790100584.012861:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141042304 00000100:00100000:0.0:1790100584.012872:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100584.012877:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1877056141042176:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790100584.012901:0:18686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:0.0:1790100584.012931:0:18686:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298287f1b 00002000:00100000:0.0:1790100584.012944:0:18686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff926083872800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1790100584.012949:0:18686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1790100584.012952:0:18686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790100584.013376:0:18686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1790100584.013399:0:18686:0:(import.c:65:import_set_state_nolock()) ffff926083875800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100584.013457:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1877056141042176:12345-0@lo:8:kworker.0 Request processed in 578us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100584.013464:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100584.013494:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100584.013498:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1877056141042304:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790100584.014196:0:18686:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1790100584.018810:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261a636b800 x1877056141042176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100584.018825:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100584.018835:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1790100584.018854:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790100584.018860:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790100584.018864:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a62f9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790100584.018875:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790100584.018881:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141042176:0@lo:8:kworker.0 00000004:00080000:1.0:1790100584.023397:0:17923:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790100584.023428:0:17923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1877056141042944:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1790100584.023490:0:17923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100584.023523:0:17923:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992f00 going to sleep for 11 seconds 00000004:00080000:1.0:1790100584.023543:0:17922:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790100584.023630:0:17922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 435311290157ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790100584.023637:0:17922:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1790100584.023662:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100584.023674:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141042816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100584.023701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100584.027622:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141042816 00000100:00100000:2.0:1790100584.027733:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141042816 00000100:00100000:2.0:1790100584.027849:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100584.027859:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1877056141042816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790100584.027891:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790100584.027980:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1877056141042816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100584.027987:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790100584.032651:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100584.032721:0:18687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790100584.032733:0:18687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790100584.033053:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141042944 00000100:00100000:3.0:1790100584.033063:0:18687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141042944 00000100:00100000:3.0:1790100584.033178:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100584.033189:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17923:x1877056141042944:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:1.0:1790100584.034207:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79ed880 x1877056141042816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100584.034230:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141042816:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1790100584.035380:0:17913:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1790100584.042060:0:19357:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1790100584.042072:0:19357:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1790100584.042226:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17923:x1877056141042944:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9035us (18732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100584.042237:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790100584.043457:0:17923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79ee680 x1877056141042944/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790100600 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100584.043474:0:17923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1877056141042944:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1790100584.043488:0:17923:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1790100584.043529:0:17923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1877056141043072:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1790100584.043571:0:17923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100584.043602:0:17923:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100584.043630:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141043072 00000100:00100000:1.0:1790100584.043637:0:18687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141043072 00000100:00100000:1.0:1790100584.043678:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100584.043687:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17923:x1877056141043072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790100584.043715:0:18687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1790100584.043750:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17923:x1877056141043072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 63us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100584.043756:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790100584.043786:0:17923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79ee680 x1877056141043072/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100600 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100584.043793:0:17923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1877056141043072:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1790100584.043801:0:17923:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1790100584.043821:0:17923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1877056141043200:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1790100584.043841:0:17923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100584.043861:0:17923:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100584.043923:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141043200 00000100:00100000:3.0:1790100584.043928:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141043200 00000100:00100000:3.0:1790100584.043956:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100584.043964:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17923:x1877056141043200:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790100584.043997:0:19357:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1790100584.047929:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1877056141042304:12345-0@lo:8:kworker.0 Request processed in 34413us (35491us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790100584.047947:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790100584.047999:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100584.048004:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790100584.048008:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141042304:0@lo:8:kworker.0 00000001:00080000:2.0:1790100584.079292:0:18683:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1790100584.079310:0:18683:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1790100584.087538:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17923:x1877056141043200:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43565us (43686us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790100584.087557:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790100584.087793:0:17923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79ee680 x1877056141043200/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100600 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100584.087812:0:17923:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790100584.087819:0:17923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1877056141043200:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1790100584.087835:0:17923:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1790100584.087885:0:17923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17923:1877056141043328:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1790100584.087920:0:17923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100584.088319:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141043328 00000100:00100000:3.0:1790100584.088327:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141043328 00000100:00100000:1.0:1790100584.088470:0:17923:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100584.088483:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100584.088493:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17923:x1877056141043328:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790100584.088558:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17923:x1877056141043328:12345-0@lo:900:osp-pre-0-1.0 Request processed in 66us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100584.088577:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790100584.091805:0:17923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9261b79ee680 x1877056141043328/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790100600 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100584.091825:0:17923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17923:1877056141043328:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1790100584.202766:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100585.224786:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100586.248613:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790100586.515412:0:19500:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790100586.515416:0:19500:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1790100586.515418:0:19500:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1790100586.515560:0:19500:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff926083d0d800 00000020:01000004:1.0:1790100586.515576:0:19500:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1790100586.515590:0:19500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790100586.515603:0:19500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff926186848000) 00000020:00000080:1.0:1790100586.515620:0:19500:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790100586.584606:0:19500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1790100586.587661:0:19500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790100586.588711:0:19500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1790100586.588895:0:19500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1790100586.589256:0:19500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1790100586.589530:0:19500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1790100586.589769:0:19500:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1790100586.590607:0:19500:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790100586.590810:0:19500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1790100586.590825:0:19500:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790100586.590835:0:19500:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc87a4f2298287f29 00000020:01000004:0.0:1790100586.590841:0:19500:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790100586.590863:0:19500:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790100586.590866:0:19500:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790100586.590872:0:19500:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1790100586.590899:0:19500:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1790100586.590903:0:19500:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790100586.605291:0:19500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790100586.605329:0:19500:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1790100586.605333:0:19500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790100586.605335:0:19500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790100586.605605:0:19500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100586.605608:0:19500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100586.605609:0:19500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100586.605610:0:19500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100586.605612:0:19500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100586.605614:0:19500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100586.605615:0:19500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790100586.605619:0:19500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1790100586.605621:0:19500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790100586.605622:0:19500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790100586.605623:0:19500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100586.605624:0:19500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100586.605632:0:19500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100586.605633:0:19500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100586.605633:0:19500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100586.605635:0:19500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100586.605636:0:19500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790100586.605661:0:19500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790100586.605681:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043456:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790100586.605752:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.605844:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100586.606464:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141043456 00000100:00100000:0.0:1790100586.606479:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141043456 00000100:00100000:0.0:1790100586.606521:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790100586.606528:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:19500:x1877056141043456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790100586.606559:0:17173:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790100586.606562:0:17173:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790100586.606565:0:17173:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790100586.606867:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:19500:x1877056141043456:12345-0@lo:253:mount.lustre.0 Request processed in 339us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.606882:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790100586.606977:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043456:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790100586.606996:0:19500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790100586.606999:0:19500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790100586.607000:0:19500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790100586.607001:0:19500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100586.607001:0:19500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100586.607002:0:19500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100586.607003:0:19500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100586.607005:0:19500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100586.607006:0:19500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100586.607007:0:19500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790100586.607040:0:19500:0:(tgt_mount.c:101:server_register_mount()) register mount ffff926083d0d800 from lustre-OST0001 10000000:01000000:1.0:1790100586.607073:0:19500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790100586.607076:0:19500:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790100586.607085:0:19500:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9261b79fcd40 local copy 00010000:00010000:1.0:1790100586.607100:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100586.607191:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100586.607224:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.607257:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100586.607369:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141043584 00000100:00100000:3.0:1790100586.607374:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141043584 00000100:00100000:3.0:1790100586.607404:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790100586.607410:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:19500:x1877056141043584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100586.607467:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:19500:x1877056141043584:12345-0@lo:501:mount.lustre.0 Request processed in 57us (242us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790100586.607473:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790100586.607635:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043584:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790100586.607647:0:19500:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790100586.607672:0:19500:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790100586.607678:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.607686:0:19500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8e000/0xc87a4f2298287c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287c4a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100586.607709:0:19500:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff926083d0d800 10000000:01000000:1.0:1790100586.607713:0:19500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790100586.607718:0:19500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790100586.607721:0:19500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100586.607724:0:19500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790100586.607727:0:19500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790100586.607748:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8fc00/0xc87a4f2298287f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.607755:0:19500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8fc00/0xc87a4f2298287f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.607764:0:19500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8fc00/0xc87a4f2298287f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100586.607776:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100586.607801:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.607888:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100586.608907:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141043712 00000100:00100000:3.0:1790100586.608916:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141043712 00000100:00100000:3.0:1790100586.608973:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790100586.608981:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:19500:x1877056141043712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100586.608994:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100586.609008:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6800/0xc87a4f2298287f37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287f30 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100586.609043:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6800/0xc87a4f2298287f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287f30 expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100586.609053:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6800/0xc87a4f2298287f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287f30 expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100586.609061:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6800, rc 0) 00000100:00100000:3.0:1790100586.609127:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141043712:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100586.609135:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790100586.609284:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100586.609299:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8fc00/0xc87a4f2298287f30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f37 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.609319:0:19500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8fc00/0xc87a4f2298287f30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287f37 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100586.610460:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790100586.610998:0:19500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100586.612766:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790100586.612814:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790100586.612831:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790100586.612844:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790100586.612855:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790100586.612867:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790100586.612890:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790100586.612896:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790100586.614661:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100586.614731:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.614833:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100586.617007:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141043840 00000100:00100000:2.0:1790100586.617033:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141043840 00000100:00100000:2.0:1790100586.617169:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790100586.617181:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141043840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100586.617399:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141043840:12345-0@lo:501:mount.lustre.0 Request processed in 219us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100586.617407:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790100586.617517:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100586.617565:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100586.617618:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.617643:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100586.617693:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141043968 00000100:00100000:0.0:1790100586.617697:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141043968 00000100:00100000:0.0:1790100586.617734:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790100586.617741:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141043968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100586.618384:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141043968:12345-0@lo:503:mount.lustre.0 Request processed in 642us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.618393:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790100586.620140:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141043968:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790100586.620596:0:19500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100586.620692:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100586.620753:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.620795:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100586.621387:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141044096 00000100:00100000:2.0:1790100586.621394:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141044096 00000100:00100000:0.0:1790100586.621484:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790100586.621497:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141044096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100586.622025:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141044096:12345-0@lo:502:mount.lustre.0 Request processed in 524us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.622033:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790100586.622198:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100586.622445:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1790100586.622477:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1790100586.622493:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1790100586.622507:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1790100586.622522:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1790100586.622536:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1790100586.622550:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1790100586.622564:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1790100586.622575:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1790100586.622603:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100586.622644:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.622679:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100586.622773:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141044224 00000100:00100000:3.0:1790100586.622779:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141044224 00000100:00100000:3.0:1790100586.622814:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790100586.622822:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141044224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100586.622918:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141044224:12345-0@lo:502:mount.lustre.0 Request processed in 97us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100586.622926:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790100586.626328:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100586.626454:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1790100586.626468:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1790100586.628691:0:19504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100586.628703:0:19504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1790100586.628709:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100586.628711:0:19504:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790100586.628718:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100586.628735:0:19504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9261b5ab4d40) 00000020:00000080:0.0:1790100586.628762:0:19504:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790100586.628774:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790100586.628840:0:19504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff926083d0d800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790100586.628849:0:19504:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790100586.628856:0:19504:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc87a4f2298287f45 00010000:00010000:0.0:1790100586.635895:0:19504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1790100586.636839:0:19504:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1790100586.638426:0:19504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1790100586.640714:0:19504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790100586.640728:0:19504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100586.640734:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100586.640736:0:19504:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790100586.640740:0:19504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100586.640744:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100586.640746:0:19504:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790100586.640749:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790100586.640751:0:19504:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790100586.640753:0:19504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100586.640755:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100586.640756:0:19504:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790100586.640758:0:19504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100586.640761:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100586.640762:0:19504:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790100586.640765:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790100586.640796:0:19504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100586.640799:0:19504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100586.640800:0:19504:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790100586.640803:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1790100586.645747:0:19500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790100586.645790:0:19500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790100586.645819:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8fc00/0xc87a4f2298287f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f37 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100586.645833:0:19500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8fc00/0xc87a4f2298287f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f37 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100586.645842:0:19500:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926083d0d800 from 1 10000000:01000000:3.0:1790100586.645844:0:19500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100586.645881:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100586.645889:0:19500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100586.645899:0:19500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100586.645923:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100586.645998:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100586.646048:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083dd7180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100586.646143:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141044352 00000100:00100000:0.0:1790100586.646150:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141044352 00000100:00100000:0.0:1790100586.646191:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790100586.646199:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+22:19500:x1877056141044352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100586.646212:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100586.646224:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287f4c expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100586.646245:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100586.646256:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100586.646265:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565d200, rc 0) 00000100:00100000:0.0:1790100586.646300:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044352:12345-0@lo:101:mount.lustre.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.646307:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790100586.646476:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100586.646490:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100586.646499:0:19500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790100586.649989:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790100586.650310:0:19500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100586.650558:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790100586.650583:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790100586.650601:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790100586.650606:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790100586.650677:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100586.650739:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100586.650775:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100586.651086:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141044480 00000100:00100000:0.0:1790100586.651094:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141044480 00000100:00100000:0.0:1790100586.651140:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790100586.651149:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100586.651257:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044480:12345-0@lo:501:mount.lustre.0 Request processed in 107us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.651264:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790100586.651378:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100586.651407:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100586.651442:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.652290:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141044608 00000100:00100000:1.0:1790100586.652298:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141044608 00000100:00100000:1.0:1790100586.652353:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790100586.652362:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100586.652471:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044608:12345-0@lo:503:mount.lustre.0 Request processed in 110us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100586.652478:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790100586.652671:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100586.652690:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790100586.653140:0:19500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100586.653208:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100586.653254:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100586.653291:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100586.653460:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141044736 00000100:00100000:1.0:1790100586.653465:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141044736 00000100:00100000:1.0:1790100586.653502:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790100586.653510:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100586.653595:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044736:12345-0@lo:502:mount.lustre.0 Request processed in 85us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100586.653603:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790100586.653686:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790100586.653846:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790100586.653873:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790100586.653888:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790100586.653914:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790100586.653931:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790100586.653945:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790100586.654076:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790100586.654093:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1790100586.654107:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790100586.654120:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1790100586.654132:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1790100586.654155:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100586.654191:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100586.654254:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b8f9a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100586.654287:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141044864 00000100:00100000:2.0:1790100586.654292:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141044864 00000100:00100000:2.0:1790100586.654325:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790100586.654332:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100586.654699:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044864:12345-0@lo:502:mount.lustre.0 Request processed in 365us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100586.654713:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790100586.654785:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790100586.654829:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1790100586.654837:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790100586.655447:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100586.655456:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100586.655459:0:19508:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790100586.655467:0:19508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff926083d0d800 00000020:00000080:3.0:1790100586.655469:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100586.655476:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100586.655479:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100586.655480:0:19508:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790100586.655482:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100586.655484:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100586.655486:0:19508:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790100586.655497:0:19508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff926083d0d800 00000020:00000080:3.0:1790100586.655499:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100586.655551:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100586.655554:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100586.655556:0:19508:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790100586.655558:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100586.655560:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100586.655562:0:19508:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790100586.655565:0:19508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff926083d0d800 00000020:00000080:3.0:1790100586.655567:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100586.655584:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100586.655586:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100586.655588:0:19508:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790100586.655590:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100586.655592:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100586.655594:0:19508:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790100586.655596:0:19508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff926083d0d800 00000020:00000080:3.0:1790100586.655599:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100586.655618:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100586.655620:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100586.655621:0:19508:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790100586.655624:0:19508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1790100586.662764:0:19500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790100586.662812:0:19500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100586.662837:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.662850:0:19500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100586.662907:0:19500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790100586.662910:0:19500:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff926083d0d800 10000000:01000000:1.0:1790100586.662912:0:19500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff926083d0d800 10000000:01000000:1.0:1790100586.662923:0:19500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100586.662929:0:19500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926083d0d800 from 1 10000000:01000000:1.0:1790100586.662931:0:19500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100586.662981:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8fe00/0xc87a4f2298287f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.662990:0:19500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8fe00/0xc87a4f2298287f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.663003:0:19500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8fe00/0xc87a4f2298287f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100586.663038:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100586.663106:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.663152:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100586.666236:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141044992 00000100:00100000:0.0:1790100586.666250:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141044992 00000100:00100000:0.0:1790100586.666316:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790100586.666327:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+23:19500:x1877056141044992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100586.666532:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100586.666550:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92619565de00/0xc87a4f2298287f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287f5a expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100586.666579:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92619565de00/0xc87a4f2298287f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287f5a expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100586.666590:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92619565de00/0xc87a4f2298287f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287f5a expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100586.666597:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565de00, rc 0) 00000100:00100000:0.0:1790100586.666673:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141044992:12345-0@lo:101:mount.lustre.0 Request processed in 347us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.666679:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790100586.666856:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141044992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100586.666872:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8fe00/0xc87a4f2298287f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f61 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100586.666882:0:19500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8fe00/0xc87a4f2298287f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287f61 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100586.668032:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1790100586.668271:0:19500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100586.668449:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790100586.668472:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1790100586.668485:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1790100586.668497:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1790100586.668509:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1790100586.668522:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1790100586.668534:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1790100586.668561:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1790100586.668575:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1790100586.668587:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1790100586.668601:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1790100586.668615:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1790100586.668628:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1790100586.668640:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1790100586.668652:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1790100586.668663:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1790100586.668676:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1790100586.668688:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1790100586.668699:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1790100586.668712:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1790100586.668725:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1790100586.668737:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1790100586.668749:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1790100586.668776:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1790100586.668792:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1790100586.668806:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1790100586.668819:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1790100586.668832:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1790100586.668844:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1790100586.668865:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1790100586.668879:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1790100586.668892:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1790100586.668905:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1790100586.668918:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1790100586.668930:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1790100586.668943:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1790100586.669412:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1790100586.669435:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1790100586.669449:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1790100586.669475:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1790100586.669490:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1790100586.669503:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1790100586.669514:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1790100586.669528:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1790100586.669541:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1790100586.669555:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1790100586.669575:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1790100586.669580:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1790100586.669660:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100586.669719:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100586.669806:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100586.674527:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141045120 00000100:00100000:3.0:1790100586.674542:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141045120 00000100:00100000:3.0:1790100586.676408:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790100586.676423:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100586.676588:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045120:12345-0@lo:501:mount.lustre.0 Request processed in 169us (6867us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100586.676597:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790100586.677310:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100586.677382:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100586.677431:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100586.677463:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b2093000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100586.677564:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141045248 00000100:00100000:2.0:1790100586.677571:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141045248 00000100:00100000:2.0:1790100586.677614:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790100586.677622:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100586.677716:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045248:12345-0@lo:503:mount.lustre.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100586.677723:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790100586.677794:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045248:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790100586.678267:0:19500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100586.678335:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100586.678408:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.678430:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100586.678491:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141045376 00000100:00100000:2.0:1790100586.678496:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141045376 00000100:00100000:2.0:1790100586.678518:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790100586.678524:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100586.678691:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045376:12345-0@lo:502:mount.lustre.0 Request processed in 166us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100586.678699:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790100586.680925:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100586.681229:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790100586.681262:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1790100586.681278:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1790100586.681293:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1790100586.681306:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1790100586.681319:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1790100586.681333:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1790100586.681365:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1790100586.681390:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790100586.681405:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1790100586.681419:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1790100586.681433:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1790100586.681446:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1790100586.681459:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1790100586.681472:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1790100586.681486:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1790100586.681500:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1790100586.681515:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1790100586.681529:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1790100586.681618:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1790100586.681634:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1790100586.681648:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1790100586.681661:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1790100586.681690:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1790100586.681706:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1790100586.681720:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1790100586.681734:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1790100586.681747:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1790100586.681869:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1790100586.681883:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1790100586.681894:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1790100586.681904:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1790100586.681914:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1790100586.681992:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1790100586.682010:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1790100586.682035:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1790100586.682047:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1790100586.682058:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1790100586.682070:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1790100586.682096:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1790100586.682112:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1790100586.682134:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1790100586.682146:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1790100586.682159:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1790100586.682171:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1790100586.682183:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1790100586.682196:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1790100586.682209:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1790100586.682258:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100586.682322:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.682525:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100586.682818:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141045504 00000100:00100000:0.0:1790100586.682826:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141045504 00000100:00100000:0.0:1790100586.682915:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790100586.682925:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100586.683067:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045504:12345-0@lo:502:mount.lustre.0 Request processed in 144us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.683075:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790100586.683148:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100586.683310:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1790100586.683335:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1790100586.683384:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100586.683423:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100586.686120:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141045632 00000100:00100000:2.0:1790100586.686134:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141045632 00000100:00100000:1.0:1790100586.686147:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790100586.686193:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790100586.686204:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100586.686500:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141045632:12345-0@lo:502:mount.lustre.0 Request processed in 297us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100586.686552:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141045632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100586.686625:0:19500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1790100586.686638:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790100586.689233:0:19513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790100586.689249:0:19513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9261b5ab3380) 00000020:00000080:0.0:1790100586.689273:0:19513:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1790100586.689409:0:19513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff926083d0d800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790100586.689414:0:19513:0:(tgt_mount.c:187:server_put_mount()) put mount ffff926083d0d800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790100586.689416:0:19513:0:(obd_mount.c:710:lustre_put_lsi()) put ffff926083d0d800 3 00010000:00080000:0.0:1790100586.689453:0:19513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9260821cf000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790100586.691299:0:19513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1790100586.691595:0:19513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790100586.691634:0:19513:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790100586.691657:0:19513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc87a4f2298287f6f 00000100:00080000:0.0:1790100586.691668:0:19513:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100586.691678:0:19513:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9260821cf000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100586.691712:0:19513:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083b71180 x1877056141045760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100586.691764:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056141045760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790100586.691827:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100586.691885:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141045760 00000100:00100000:0.0:1790100586.691892:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141045760 00000100:00100000:0.0:1790100586.691919:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100586.691926:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1877056141045760:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790100586.691948:0:17180:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:0.0:1790100586.692123:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc87a4f2298287f76 00000004:00100000:0.0:1790100586.692138:0:17180:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790100586.692169:0:17180:0:(import.c:65:import_set_state_nolock()) ffff92608210b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100586.692433:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877056141045760:12345-0@lo:38:llog_process_th.0 Request processed in 505us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.692442:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790100586.692485:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083b71180 x1877056141045760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100586.692494:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100586.692501:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00100000:3.0:1790100586.693696:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1790100586.694198:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790100586.694205:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790100586.694209:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9260821cf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790100586.694218:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1877056141045760:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790100586.694245:0:19513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790100586.694303:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100586.694307:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100586.694310:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100586.694313:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100586.694352:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100586.694356:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790100586.694357:0:38:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100586.694361:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1790100586.694366:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790100586.694504:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff926083b6a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100586.694526:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083b72d80 x1877056141046400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100586.694582:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141045888:0@lo:400:kworker.0 00000100:00100000:0.0:1790100586.694634:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100586.694690:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141046528:0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.695083:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141046144:0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.695115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.695138:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141046784:0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.695164:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.695186:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100586.695192:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141046272:0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.695214:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100586.695243:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141045888 00000100:00100000:1.0:1790100586.695258:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141045888 00000100:00100000:1.0:1790100586.695295:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141046144 00000100:00100000:1.0:1790100586.695298:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141046144 00000100:00100000:1.0:1790100586.695314:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100586.695321:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.695383:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141045888:12345-0@lo:400:kworker.0 Request processed in 62us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100586.695390:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100586.695405:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790100586.695412:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141046144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.695442:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141046144:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100586.695448:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790100586.695467:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141046784 00000100:00100000:1.0:1790100586.695470:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141046784 00000100:00100000:1.0:1790100586.695502:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100586.695508:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141046784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.695674:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141046784:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100586.695681:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100586.695703:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141046272 00000100:00100000:1.0:1790100586.695707:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141046272 00000100:00100000:1.0:1790100586.696095:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100586.696103:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141046272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.696141:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141046272:12345-0@lo:400:kworker.0 Request processed in 39us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100586.696147:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790100586.696256:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083b71f80 x1877056141046272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100586.696269:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141046272:0@lo:400:kworker.0 00000100:00100000:1.0:1790100586.696278:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141046144:0@lo:400:kworker.0 00010000:00080000:1.0:1790100586.696287:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083b71500 x1877056141046784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100586.696294:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141046784:0@lo:400:kworker.0 00000100:00080000:1.0:1790100586.696318:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100586.696324:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790100586.696661:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056141046016:0@lo:400:kworker.0 00000100:00100000:3.0:1790100586.696694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100586.696714:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056141046656:0@lo:400:kworker.0 00000100:00100000:3.0:1790100586.696732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100586.697060:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100586.697100:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141045888:0@lo:400:kworker.0 00000100:00100000:0.0:1790100586.697127:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141046016 00000100:00100000:0.0:1790100586.697131:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141046016 00000100:00100000:0.0:1790100586.697156:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141046656 00000100:00100000:0.0:1790100586.697158:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141046656 00000100:00100000:0.0:1790100586.697177:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141046528 00000100:00100000:0.0:1790100586.697180:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141046528 00000100:00100000:0.0:1790100586.697191:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100586.697197:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056141046016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100586.697235:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056141046016:12345-0@lo:400:kworker.0 Request processed in 38us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.697241:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100586.697254:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100586.697260:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056141046656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100586.697304:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056141046656:12345-0@lo:400:kworker.0 Request processed in 43us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.697310:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100586.697322:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100586.697328:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141046528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100586.697375:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141046528:12345-0@lo:400:kworker.0 Request processed in 47us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.697391:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1790100586.697417:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083b70700 x1877056141046016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100586.697427:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056141046016:0@lo:400:kworker.0 00010000:00080000:0.0:1790100586.697436:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083b70a80 x1877056141046656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100586.697444:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056141046656:0@lo:400:kworker.0 00000100:00100000:0.0:1790100586.697465:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141046400:0@lo:8:kworker.0 00000100:00100000:0.0:1790100586.697489:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790100586.697524:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790100586.697529:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083b73b80 x1877056141046528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100586.697537:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141046528:0@lo:400:kworker.0 00000100:00100000:3.0:1790100586.697652:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141046400 00000100:00100000:3.0:1790100586.697657:0:18687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141046400 00000100:00100000:3.0:1790100586.697689:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100586.697694:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1877056141046400:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1790100586.697746:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1877056141046400:12345-0@lo:8:kworker.0 Request processed in 50us (255us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790100586.697752:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100586.699069:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100586.699080:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100586.699086:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790100586.699090:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141046400:0@lo:8:kworker.0 00000020:01000004:0.0:1790100586.699199:0:19513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790100586.699213:0:19513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9261b5ab0000) 00000020:00000080:0.0:1790100586.699235:0:19513:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1790100586.699304:0:19513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff926083d0d800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790100586.699307:0:19513:0:(tgt_mount.c:187:server_put_mount()) put mount ffff926083d0d800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790100586.699310:0:19513:0:(obd_mount.c:710:lustre_put_lsi()) put ffff926083d0d800 3 00010000:00080000:0.0:1790100586.699355:0:19513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92608210b000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790100586.702918:0:19513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1790100586.705844:0:19513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1790100586.705890:0:19513:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790100586.705902:0:19513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc87a4f2298287f84 00000100:00080000:0.0:1790100586.705912:0:19513:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100586.705923:0:19513:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff92608210b000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790100586.707078:0:19513:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083b72d80 x1877056141046912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100586.707124:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1877056141046912:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790100586.707190:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100586.707250:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141046912 00000100:00100000:0.0:1790100586.707258:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141046912 00000100:00100000:0.0:1790100586.707292:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100586.707299:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877056141046912:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790100586.707324:0:17182:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:0.0:1790100586.707384:0:17182:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc87a4f2298287f8b 00000004:00100000:0.0:1790100586.707398:0:17182:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790100586.707428:0:17182:0:(import.c:65:import_set_state_nolock()) ffff92608210d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100586.707474:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877056141046912:12345-0@lo:38:llog_process_th.0 Request processed in 174us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100586.707483:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790100586.707522:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff926083b72d80 x1877056141046912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100586.707531:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100586.707539:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790100586.707545:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790100586.707549:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790100586.707557:0:3640:0:(import.c:65:import_set_state_nolock()) ffff92608210b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790100586.707562:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1877056141046912:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790100586.707580:0:19513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790100586.707600:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100586.707604:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790100586.707607:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100586.707610:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1790100586.712943:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1790100586.716966:0:19500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790100586.717011:0:19500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790100586.717043:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8fe00/0xc87a4f2298287f5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f61 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.717055:0:19500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8fe00/0xc87a4f2298287f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287f61 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790100586.717107:0:19500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790100586.717109:0:19500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790100586.717115:0:19500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100586.717116:0:19500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100586.717117:0:19500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100586.717119:0:19500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100586.717120:0:19500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100586.717122:0:19500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100586.717123:0:19500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790100586.717126:0:19500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1790100586.717128:0:19500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100586.717129:0:19500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790100586.717130:0:19500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100586.717131:0:19500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100586.717132:0:19500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100586.717133:0:19500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100586.717134:0:19500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100586.717135:0:19500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100586.717136:0:19500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790100586.717160:0:19500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790100586.717179:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141047040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790100586.717241:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100586.717274:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff926082bf5480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100586.717312:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141047040 00000100:00100000:2.0:1790100586.717319:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141047040 00000100:00100000:2.0:1790100586.717399:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790100586.717407:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141047040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790100586.717431:0:17175:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790100586.717443:0:17175:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790100586.725570:0:17175:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790100586.725594:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790100586.725611:0:17196:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790100586.725616:0:17196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790100586.725639:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.725657:0:17196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287eff expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.725665:0:17196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.725673:0:17196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.725716:0:17196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.725729:0:17196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 24 pid: 17175 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100586.725758:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141047168:0@lo:104: 00000100:00100000:1.0:1790100586.725821:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100586.725996:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:19500:x1877056141047040:12345-0@lo:253:mount.lustre.0 Request processed in 8588us (8752us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100586.726007:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:1.0:1790100586.726009:0:17196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287eff expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.726028:0:17196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287eff expref: 24 pid: 17174 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100586.726036:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141047296:0@lo:104: 00000100:00100000:1.0:1790100586.726058:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100586.727463:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:687676b7-da9e-40a3-8051-3299bac6cf99:19500:1877056141047040:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790100586.727479:0:19500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790100586.727482:0:19500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100586.727484:0:19500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790100586.727485:0:19500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100586.727486:0:19500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100586.727487:0:19500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100586.727488:0:19500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100586.727489:0:19500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100586.727500:0:19500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100586.727502:0:19500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790100586.727515:0:19500:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790100586.731847:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100586.732222:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141047168 00000100:00100000:2.0:1790100586.732231:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141047168 00000100:00100000:2.0:1790100586.732271:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141047296 00000100:00100000:2.0:1790100586.732274:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141047296 00000100:00100000:2.0:1790100586.732291:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100586.732300:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+4:17196:x1877056141047168:12345-0@lo:104: 00010000:00010000:2.0:1790100586.732318:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732710:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100586.732717:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+4:17196:x1877056141047168:12345-0@lo:104: Request processed in 418us (6897us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100586.732725:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100586.732744:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100586.732762:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:17196:x1877056141047296:12345-0@lo:104: 00010000:00010000:2.0:1790100586.732770:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732804:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790100586.732809:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:17196:x1877056141047296:12345-0@lo:104: Request processed in 59us (6750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100586.732814:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1790100586.732830:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100586.732836:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732843:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565dc00 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100586.732847:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732856:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100586.732864:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100586.732870:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100586.732909:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732915:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100586.732946:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732954:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f14 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732966:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100586.732969:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732984:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d600 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:2.0:1790100586.732987:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.732994:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100586.733001:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100586.733006:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100586.733026:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733032:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100586.733048:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733066:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287eff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f06 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733079:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100586.733081:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100586.733083:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100586.733089:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100586.733108:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141047424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100586.733144:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100586.733177:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141047552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100586.733198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100586.733230:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141047424 00000100:00100000:2.0:1790100586.733234:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141047424 00010000:00010000:2.0:1790100586.733252:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 24 pid: 17175 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100586.733270:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141047552 00000100:00100000:2.0:1790100586.733273:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141047552 00010000:00010000:2.0:1790100586.733284:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287eff expref: 25 pid: 17174 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100586.733300:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100586.733306:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:687676b7-da9e-40a3-8051-3299bac6cf99+25:3644:x1877056141047424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100586.733316:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100586.733321:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 25 pid: 17175 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733376:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 25 pid: 17175 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733392:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100586.733419:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:687676b7-da9e-40a3-8051-3299bac6cf99+25:3644:x1877056141047424:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100586.733426:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100586.733439:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100586.733445:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:687676b7-da9e-40a3-8051-3299bac6cf99+24:3641:x1877056141047552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100586.733452:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100586.733456:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287eff expref: 24 pid: 17174 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733465:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287eff expref: 24 pid: 17174 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733476:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733484:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790100586.733498:0:17167:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009187787s 00010000:00010000:2.0:1790100586.733503:0:17167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733510:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733527:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733544:0:17167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733551:0:17167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100586.733555:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733563:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733571:0:17167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100586.733581:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100586.733608:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:687676b7-da9e-40a3-8051-3299bac6cf99+24:3641:x1877056141047552:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100586.733614:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100586.733653:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141047424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100586.733676:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141047552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100586.734628:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926a00/0xc87a4f2298287f14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287f0d expref: 23 pid: 17175 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100586.734642:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141047168:0@lo:104: 00010000:00010000:1.0:1790100586.734652:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7000/0xc87a4f2298287f06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287eff expref: 22 pid: 17174 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100586.734659:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17196:1877056141047296:0@lo:104: 00010000:00010000:1.0:1790100586.734677:0:17196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.734686:0:17196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.734692:0:17196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100586.734713:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926184b8f800/0xc87a4f2298287f92 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1790100586.744626:0:19500:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790100586.747648:0:19500:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790100586.747657:0:19500:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790100586.747689:0:19500:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790100586.747726:0:19500:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790100586.747742:0:19500:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1790100586.747759:0:19500:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1790100586.748433:0:19500:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100586.748641:0:19500:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1790100586.761336:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790100587.272939:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790100587.745057:0:19567:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790100587.745303:0:19567:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1790100588.105852:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790100588.113322:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9261b5ae0000 from 10 10000000:01000000:0.0:1790100588.113329:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100588.113410:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.113422:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.113434:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100588.113459:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141047680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100588.113525:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100588.113580:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b20939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100588.113696:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141047680 00000100:00100000:1.0:1790100588.113704:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141047680 00000100:00100000:1.0:1790100588.113757:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100588.113766:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+22:17177:x1877056141047680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100588.113778:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100588.113792:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926184b8f600/0xc87a4f2298287fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287f99 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.113816:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926184b8f600/0xc87a4f2298287fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287f99 expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.113827:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926184b8f600/0xc87a4f2298287fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287f99 expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.113835:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f600, rc 0) 00000100:00100000:1.0:1790100588.113874:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141047680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100588.113881:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790100588.113983:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141047680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100588.113998:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287fa0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.114035:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287fa0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100588.114083:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141047808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790100588.114113:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100588.114142:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b20939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100588.114255:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141047808 00000100:00100000:1.0:1790100588.114259:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141047808 00000100:00100000:1.0:1790100588.114290:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790100588.114297:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141047808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790100588.114311:0:17175:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790100588.114332:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790100588.114336:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1790100588.114428:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141047808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100588.114435:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790100588.116089:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141047808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790100588.116166:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100588.116175:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287f99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287fa0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.116186:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565d600/0xc87a4f2298287f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287fa0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100588.116195:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790100588.116197:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926184c6f000 from 10 10000000:01000000:0.0:1790100588.116200:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100588.116232:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.116240:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.116249:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100588.116268:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141047936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100588.116330:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100588.116393:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b20939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100588.116464:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141047936 00000100:00100000:1.0:1790100588.116471:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141047936 00000100:00100000:1.0:1790100588.116520:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790100588.116530:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141047936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100588.116542:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100588.116566:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926184b8ec00/0xc87a4f2298287fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298287fa7 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.116587:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926184b8ec00/0xc87a4f2298287fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298287fa7 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.116596:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926184b8ec00/0xc87a4f2298287fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287fa7 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.116604:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8ec00, rc 0) 00000100:00100000:1.0:1790100588.116640:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:17177:x1877056141047936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100588.116645:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790100588.116866:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141047936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100588.116878:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287fae expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.116887:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298287fae expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100588.116929:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141048064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790100588.116971:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100588.116998:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b20939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100588.117135:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141048064 00000100:00100000:1.0:1790100588.117141:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141048064 00000100:00100000:1.0:1790100588.117172:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790100588.117180:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+24:17177:x1877056141048064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790100588.117193:0:17173:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790100588.117209:0:17173:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790100588.117216:0:17173:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1790100588.117291:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+24:17177:x1877056141048064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100588.117298:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790100588.120717:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141048064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790100588.120795:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100588.120805:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287fae expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.120815:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff92619565dc00/0xc87a4f2298287fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298287fae expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100588.306435:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100589.000835:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100589.000858:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141048192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790100589.000930:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100589.001100:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141048192 00000100:00100000:2.0:1790100589.001119:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141048192 00000100:00100000:2.0:1790100589.001186:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790100589.001195:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141048192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100589.001230:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790100589.001277:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141048192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100589.001284:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790100589.001327:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141048192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100589.001742:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141048320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100589.001773:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100589.002068:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141048320 00000100:00100000:3.0:1790100589.002074:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141048320 00000100:00100000:3.0:1790100589.002117:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790100589.002125:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141048320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100589.002146:0:17921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790100589.002193:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141048320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100589.002200:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790100589.002312:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141048320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790100589.320626:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100589.515165:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141048448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100589.515235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100589.515316:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141048448 00000100:00100000:2.0:1790100589.515324:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141048448 00000100:00100000:2.0:1790100589.515400:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100589.515410:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141048448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790100589.515437:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1790100589.515528:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100589.523529:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141048448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8113us (8285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100589.523542:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790100589.523717:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083286300 x1877056141048448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.523744:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141048448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100589.774140:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100569/real 1790100569] req@ffff926083285f80 x1877056141034496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100589 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100589.774168:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff926083285f80 x1877056141034496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100589 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100589.774178:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100569/real 1790100569] req@ffff926083285880 x1877056141034624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100589 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100589.774188:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff926083285880 x1877056141034624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100589 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790100589.774225:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a24c3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100589.774248:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790100589.774253:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141034496:0@lo:8:kworker.0 00000100:00080000:2.0:1790100589.774258:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2023000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100589.774263:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790100589.774266:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141034624:0@lo:8:kworker.0 00000100:00080000:3.0:1790100589.774456:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100589.774461:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790100589.774464:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261a24c3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790100589.774468:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1790100589.774473:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790100589.774482:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9261a24c3000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100589.774501:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083287800 x1877056141048832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100589.774509:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141048704:0@lo:400:kworker.0 00000100:00100000:1.0:1790100589.774569:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141048832:0@lo:8:kworker.0 00000100:00100000:0.0:1790100589.774594:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100589.774610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.774631:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100589.774640:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141048576:0@lo:400:kworker.0 00000100:00080000:3.0:1790100589.774718:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1790100589.774725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790100589.774726:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790100589.774730:0:38:0:(import.c:65:import_set_state_nolock()) ffff9261b2023000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790100589.774734:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1790100589.774737:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790100589.774743:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9261b2023000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100589.774762:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083285880 x1877056141048960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100589.774810:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141048576 00000100:00100000:2.0:1790100589.774817:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141048576 00000100:00100000:1.0:1790100589.774855:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141048960:0@lo:8:kworker.0 00000100:00100000:2.0:1790100589.774868:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790100589.774881:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:3642:x1877056141048576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100589.774896:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100589.774947:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141048704 00000100:00100000:1.0:1790100589.774953:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141048704 00000100:00100000:2.0:1790100589.774954:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:3642:x1877056141048576:12345-0@lo:400:kworker.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100589.774963:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790100589.774988:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790100589.775007:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141048704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100589.775021:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141048576:0@lo:400:kworker.0 00000100:00100000:1.0:1790100589.775059:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141048704:12345-0@lo:400:kworker.0 Request processed in 63us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100589.775068:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141048704:0@lo:400:kworker.0 00000100:00100000:1.0:1790100589.775068:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790100589.775104:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141048832 00000100:00100000:1.0:1790100589.775109:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141048832 00000100:00100000:1.0:1790100589.775129:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141048960 00000100:00100000:1.0:1790100589.775132:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141048960 00000100:00100000:1.0:1790100589.775148:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100589.775153:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1877056141048832:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790100589.775187:0:18686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1790100589.775211:0:18686:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298287fb5 00002000:00100000:1.0:1790100589.775229:0:18686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9261a631e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1790100589.775233:0:18686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1790100589.775236:0:18686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790100589.775310:0:18686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1790100589.775327:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100589.775334:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1877056141048960:12345-0@lo:8:kworker.0 00000100:00080000:1.0:1790100589.775334:0:18686:0:(import.c:65:import_set_state_nolock()) ffff9261a631a000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1790100589.775373:0:18687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1790100589.775393:0:18687:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc87a4f2298287fbc 00002000:00100000:2.0:1790100589.775401:0:18687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff926193b8f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790100589.775405:0:18687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790100589.775407:0:18687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1790100589.775418:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1877056141048832:12345-0@lo:8:kworker.0 Request processed in 262us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100589.775425:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:2.0:1790100589.775565:0:18687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790100589.775579:0:18687:0:(import.c:65:import_set_state_nolock()) ffff926193b8c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100589.775608:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1877056141048960:12345-0@lo:8:kworker.0 Request processed in 274us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100589.775614:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790100589.775685:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083285880 x1877056141048960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.775693:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100589.775699:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790100589.775705:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790100589.775710:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790100589.775711:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261b2023000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790100589.775734:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790100589.775739:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141048960:0@lo:8:kworker.0 00010000:00080000:0.0:1790100589.775752:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083287800 x1877056141048832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.775758:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100589.775762:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790100589.775766:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790100589.775769:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790100589.775770:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9261a24c3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790100589.775780:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790100589.775783:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1877056141048832:0@lo:8:kworker.0 00000004:00080000:1.0:1790100589.775854:0:17206:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790100589.776014:0:17206:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441063674527ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790100589.776021:0:17206:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1790100589.776043:0:17207:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000004:00080000:1.0:1790100589.776061:0:17205:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1790100589.776070:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17207:1877056141049344:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790100589.776105:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100589.776123:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261862f99c0 going to sleep for 11 seconds 00000004:00080000:2.0:1790100589.776135:0:17204:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790100589.776142:0:17205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17205:1877056141049472:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790100589.776180:0:17204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441063839666ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790100589.776185:0:17204:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1790100589.776230:0:17205:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.776240:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141049088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100589.776255:0:17205:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261909a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100589.776274:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.776299:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100589.776315:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141049216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100589.776373:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.776413:0:18691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141049088 00000100:00100000:0.0:1790100589.776418:0:18691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141049088 00000100:00100000:0.0:1790100589.776449:0:18691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141049216 00000100:00100000:0.0:1790100589.776452:0:18691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141049216 00000100:00100000:0.0:1790100589.776467:0:18691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100589.776474:0:18691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056141049088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100589.776494:0:18691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790100589.776544:0:18691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056141049088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100589.776550:0:18691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100589.776566:0:18691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100589.776573:0:18691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056141049216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100589.776583:0:18691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790100589.776609:0:18691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056141049216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100589.776615:0:18691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1790100589.776633:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100589.776637:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790100589.776658:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b79ee680 x1877056141049216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.776674:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141049216:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790100589.776685:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a6369180 x1877056141049088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.776697:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141049088:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790100589.777454:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100589.777459:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790100589.777462:0:38:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790100589.777474:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff926083b6a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790100589.777493:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff926083286a00 x1877056141049984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100589.777962:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056141050112:0@lo:400:kworker.0 00000100:00100000:0.0:1790100589.778022:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.778058:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141050624:0@lo:400:kworker.0 00000100:00100000:0.0:1790100589.778078:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.778099:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790100589.778105:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141049856:0@lo:400:kworker.0 00000100:00100000:0.0:1790100589.778126:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.778145:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056141050496:0@lo:400:kworker.0 00000100:00100000:0.0:1790100589.778168:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.778194:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141050112 00000100:00100000:0.0:1790100589.778200:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141050112 00000100:00100000:0.0:1790100589.778229:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141050624 00000100:00100000:0.0:1790100589.778232:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141050624 00000100:00100000:0.0:1790100589.778253:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141050496 00000100:00100000:0.0:1790100589.778256:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141050496 00000100:00100000:0.0:1790100589.778270:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790100589.778278:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056141050112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100589.778322:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056141050112:12345-0@lo:400:kworker.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100589.778328:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790100589.778366:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100589.778374:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056141050624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100589.778385:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141049344 00000100:00100000:1.0:1790100589.778392:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141049344 00000100:00100000:0.0:1790100589.778404:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056141050624:12345-0@lo:400:kworker.0 Request processed in 32us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100589.778411:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100589.778427:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790100589.778430:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141049472 00000100:00100000:1.0:1790100589.778435:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141049472 00000100:00100000:0.0:1790100589.778450:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056141050496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100589.778452:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141049856 00000100:00100000:1.0:1790100589.778456:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141049856 00000100:00100000:1.0:1790100589.778475:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100589.778485:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100589.778492:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b79ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056141050496:12345-0@lo:400:kworker.0 Request processed in 45us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100589.778498:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790100589.778530:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141049856:12345-0@lo:400:kworker.0 Request processed in 48us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100589.778538:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100589.778554:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100589.778560:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17207:x1877056141049344:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790100589.779473:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141049600:0@lo:400:kworker.0 00000100:00100000:3.0:1790100589.779517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100589.779600:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790100589.779612:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17205:x1877056141049472:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790100589.779778:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141049728:0@lo:400:kworker.0 00000100:00100000:2.0:1790100589.779809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100589.779833:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056141050368:0@lo:400:kworker.0 00000100:00100000:2.0:1790100589.779856:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141049728 00000100:00100000:2.0:1790100589.779860:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141049728 00000100:00100000:2.0:1790100589.779892:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790100589.779898:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141049728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100589.779938:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141049728:12345-0@lo:400:kworker.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100589.779944:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790100589.781131:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141050240:0@lo:400:kworker.0 00000100:00100000:3.0:1790100589.781193:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100589.781240:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141049600 00000100:00100000:3.0:1790100589.781246:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141049600 00000100:00100000:3.0:1790100589.781276:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141050240 00000100:00100000:3.0:1790100589.781279:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141050240 00000100:00100000:3.0:1790100589.781298:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100589.781306:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141049600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100589.781378:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141049600:12345-0@lo:400:kworker.0 Request processed in 72us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100589.781385:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100589.781400:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100589.781406:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141050240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100589.781434:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141050240:12345-0@lo:400:kworker.0 Request processed in 29us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100589.781439:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790100589.781473:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083285f80 x1877056141049600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100589.781486:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141049600:0@lo:400:kworker.0 00010000:00080000:3.0:1790100589.781496:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083287800 x1877056141050240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100589.781504:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141050240:0@lo:400:kworker.0 00000100:00080000:0.0:1790100589.781658:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100589.781663:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790100589.781694:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083284e00 x1877056141049856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.781707:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141049856:0@lo:400:kworker.0 00010000:00080000:0.0:1790100589.781720:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083285180 x1877056141050496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.781728:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056141050496:0@lo:400:kworker.0 00010000:00080000:0.0:1790100589.781739:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083284000 x1877056141050112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.781747:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056141050112:0@lo:400:kworker.0 00010000:00080000:0.0:1790100589.781759:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083287b80 x1877056141050624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.781767:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141050624:0@lo:400:kworker.0 00000100:00100000:0.0:1790100589.781800:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141049984:0@lo:8:kworker.0 00000100:00100000:0.0:1790100589.781832:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100589.782409:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1790100589.782419:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1790100589.782712:0:18688:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1790100589.782722:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141049984 00000100:00100000:3.0:1790100589.782728:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141049984 00002000:00080000:1.0:1790100589.782828:0:19357:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1790100589.782835:0:19357:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1790100589.782839:0:19357:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:2.0:1790100589.783278:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100589.783419:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141049728:0@lo:400:kworker.0 00000100:00100000:3.0:1790100589.783612:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141050368 00000100:00100000:3.0:1790100589.783617:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141050368 00000100:00100000:3.0:1790100589.783792:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100589.783800:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056141050368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100589.783883:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056141050368:12345-0@lo:400:kworker.0 Request processed in 84us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100589.783890:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1790100589.784081:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790100589.784107:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926083285880 x1877056141050368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100589.784118:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056141050368:0@lo:400:kworker.0 00002000:00080000:2.0:1790100589.784509:0:18687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1790100589.784639:0:18687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1790100589.784645:0:18687:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1790100589.795818:0:17160:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790100589.795867:0:17160:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1790100589.796588:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.796599:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.796618:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.796623:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.796630:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.796648:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.796660:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.796668:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.796686:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790100589.798673:0:19675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100589.798685:0:19675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3640:x1877056141049984:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790100589.798727:0:19675:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:0.0:1790100589.798759:0:19675:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc87a4f2298287fca 00002000:00100000:0.0:1790100589.798775:0:19675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff926082109000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1790100589.798780:0:19675:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1790100589.798783:0:19675:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790100589.800041:0:19675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1790100589.800070:0:19675:0:(import.c:65:import_set_state_nolock()) ffff92608210a800 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1790100589.800440:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100589.800449:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.800463:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100589.800467:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.800479:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.800500:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.800508:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f2298287fc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.800529:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.800530:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.800532:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100589.800677:0:19675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3640:x1877056141049984:12345-0@lo:8:kworker.0 Request processed in 1990us (18841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100589.800685:0:19675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1790100589.809072:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790100589.809087:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790100589.809104:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790100589.809107:0:3640:0:(import.c:65:import_set_state_nolock()) ffff926083b6a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790100589.809125:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790100589.809145:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1877056141049984:0@lo:8:kworker.0 00002000:00010000:0.0:1790100589.809605:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.809615:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.809630:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.809633:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.809639:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.809654:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.809664:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.809672:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.809700:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1790100589.814513:0:17925:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790100589.814542:0:17925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1877056141050880:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1790100589.814615:0:17925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100589.814647:0:17925:0:(client.c:2716:ptlrpc_set_wait()) set ffff92619448d300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100589.814665:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141050752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100589.814689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100589.814751:0:18691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141050752 00000100:00100000:3.0:1790100589.814758:0:18691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141050752 00000100:00100000:3.0:1790100589.814811:0:18691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100589.814820:0:18691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1877056141050752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790100589.814840:0:18691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790100589.814883:0:18691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1877056141050752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100589.814890:0:18691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1790100589.815198:0:17924:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790100589.815281:0:17924:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 441102941472ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790100589.815288:0:17924:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:2.0:1790100589.815319:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.815327:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.815366:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.815371:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.815382:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.815402:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.815410:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298287fd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.815442:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.815443:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.815445:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790100589.815457:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100589.816358:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141050752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790100589.816396:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141050880 00000100:00100000:3.0:1790100589.816402:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141050880 00000100:00100000:3.0:1790100589.816442:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100589.816450:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17925:x1877056141050880:12345-0@lo:7:osp-pre-1-1.0 00002000:00010000:2.0:1790100589.817378:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.817388:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.817403:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.817408:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.817415:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.817432:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.817442:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.817450:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.817469:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790100589.818199:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.818207:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.818219:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.818222:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.818226:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.818236:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.818243:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.818249:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.818269:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790100589.818591:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100589.818600:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818609:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.818613:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818622:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818644:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818651:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298287fd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818671:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.818675:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818681:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687c00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.818684:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818691:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818709:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818715:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e4f2530/0xc87a4f2298287fdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.818730:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.818731:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.818733:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.819013:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.819020:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.819029:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.819038:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.819043:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.819052:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.819061:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.819068:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.819079:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.819903:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.819910:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.819920:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.819924:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.819943:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.819958:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.819966:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddfdc1ab/0xc87a4f2298287fe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.820004:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.820006:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.820008:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.820173:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.820225:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.820231:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.820248:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.820251:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.820255:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.820265:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.820274:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.820282:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100589.820472:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.820479:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.820486:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.820490:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.820494:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.820503:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.820512:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.820525:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.820606:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790100589.821161:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.821167:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.821177:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.821180:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.821185:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.821195:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.821214:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.821222:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1790100589.822417:0:18688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1790100589.822427:0:18688:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790100589.822517:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17925:x1877056141050880:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6063us (7897us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100589.822527:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100589.822580:0:17925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1877056141050880:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1790100589.822592:0:17925:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790100589.822627:0:17925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1877056141051008:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1790100589.822656:0:17925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100589.822679:0:17925:0:(client.c:2716:ptlrpc_set_wait()) set ffff92619448d300 going to sleep for 11 seconds 00010000:00010000:0.0:1790100589.826160:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1790100589.826225:0:17913:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1790100589.826266:0:19675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141051008 00000100:00100000:0.0:1790100589.826277:0:19675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141051008 00000100:00100000:0.0:1790100589.826334:0:19675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790100589.826364:0:19675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17925:x1877056141051008:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790100589.826395:0:19675:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1790100589.826467:0:19675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17925:x1877056141051008:12345-0@lo:5:osp-pre-1-1.0 Request processed in 106us (3809us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100589.826474:0:19675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790100589.827042:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790100589.827051:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827076:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100589.827081:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827092:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827113:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827122:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298287fed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827146:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100589.827151:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827157:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100589.827160:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827168:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827177:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827191:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298287ff4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827207:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100589.827210:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827217:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100589.827220:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827228:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827239:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.827246:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.827247:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.827249:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100589.827287:0:17925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1877056141051008:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790100589.827300:0:17925:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790100589.827355:0:17925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1877056141051136:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1790100589.827395:0:17925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100589.827427:0:17925:0:(client.c:2716:ptlrpc_set_wait()) set ffff92619448d300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100589.827445:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141051136 00000100:00100000:3.0:1790100589.827449:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141051136 00000100:00100000:3.0:1790100589.827480:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100589.827488:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17925:x1877056141051136:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1790100589.827517:0:18688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:1.0:1790100589.829203:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.829775:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.829784:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.831040:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.831045:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.831053:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.831070:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.831082:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.831098:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.831128:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100589.831434:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100589.831442:0:18687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298287ffb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.831491:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.831496:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.831504:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.831508:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.831517:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.831533:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.831540:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f2298288002 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.831561:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.831563:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.831565:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.831969:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.832417:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.832425:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.832438:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.832442:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.832448:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.832460:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.832469:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.832476:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.832491:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790100589.833466:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.833476:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833495:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.833499:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.833503:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833514:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833523:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833530:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833547:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790100589.833561:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100589.833568:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833576:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.833581:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833591:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833620:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833628:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4fd1486/0xc87a4f2298288009 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833648:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.833652:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833658:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ee00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.833662:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833670:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833679:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833686:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000954252b8/0xc87a4f2298288010 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.833699:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.833700:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.833709:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.834029:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.834036:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834045:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.834048:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.834052:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834062:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834071:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834078:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834095:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100589.834103:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.834106:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834121:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.834124:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834132:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834142:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834149:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f2298288017 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.834162:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.834163:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.834165:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.834374:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.835568:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.835580:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.835596:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.835599:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.835605:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.835617:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.835635:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.835642:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.835660:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100589.837177:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100589.837188:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.837201:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100589.837206:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.837218:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.837238:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.837246:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cd4c396/0xc87a4f229828801e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.837270:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.837272:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.837273:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.838833:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.838846:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.839267:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.839274:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.839281:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.839298:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.839309:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.839317:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.839373:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100589.839634:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.839642:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.839651:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.839656:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.839665:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.839684:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.839690:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fe6899d/0xc87a4f2298288025 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.839711:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.839713:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.839715:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.840186:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.840195:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.840206:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.840209:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.840214:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.840225:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.840234:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.840241:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.840280:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.842019:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.842030:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.842043:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.842047:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.842071:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.842091:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.842100:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828802c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.842122:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.842124:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.842126:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.842251:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.842258:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.842276:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.842280:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.842286:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.842304:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.842313:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.842321:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.842370:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790100589.842407:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.842413:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.842421:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.842424:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.842428:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.842436:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.842444:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.842450:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.842466:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790100589.842571:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100589.842578:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842592:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100589.842595:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842603:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842616:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842623:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f2298288033 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842637:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100589.842641:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842648:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100589.842651:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842658:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842668:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842682:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828803a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.842696:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.842698:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.842699:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.842831:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.843265:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.843273:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.843283:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.843286:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.843291:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.843301:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.843310:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.843332:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.843387:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100589.843585:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100589.843591:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.843599:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100589.843602:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.843609:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.843624:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.843631:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f2298288041 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100589.843644:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.843646:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100589.843648:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.843766:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.843772:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.843780:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.843789:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.843803:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.843814:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.843823:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.843830:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.843849:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.844233:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.844239:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.844247:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.844251:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.844259:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.844272:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.844280:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079110ebf/0xc87a4f2298288048 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.844294:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.844295:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.844297:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.850430:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.850445:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.850462:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.850467:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.850473:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.850488:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.850498:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.850519:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.850541:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790100589.851790:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.851814:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.851829:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.851834:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.851839:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.851852:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.851861:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.851868:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.851894:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790100589.851909:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100589.851915:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852284:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.852289:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852298:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852318:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852325:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a8e058c/0xc87a4f229828804f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852363:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.852367:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852374:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.852377:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852384:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852394:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.852402:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.852408:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b5a96d0/0xc87a4f2298288056 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.852420:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.852422:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.852424:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.852496:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.852502:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.852511:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.852514:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.852517:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.852527:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.852543:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.852550:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.852570:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.852755:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.852760:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.852768:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.852771:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.852779:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.852790:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.852797:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef6e7b97/0xc87a4f229828805d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.852823:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.852825:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.852826:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.853035:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.853041:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853049:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.853053:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.853057:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853066:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853075:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853082:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853108:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100589.853390:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.853395:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853404:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.853408:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853415:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853428:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853435:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090a356f1/0xc87a4f2298288064 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100589.853446:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.853448:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.853450:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.853451:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.853452:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.853459:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.853462:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.853467:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.853487:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.853495:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.853501:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.853521:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100589.853552:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.853557:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853565:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ee00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.853568:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853576:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853587:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853594:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f229828806b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853608:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.853610:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.853612:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.853737:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.853744:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853752:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.853755:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.853758:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853768:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853774:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853781:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.853800:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100589.853882:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.853887:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853895:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.853898:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.853917:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100589.854015:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.854021:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854030:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.854032:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.854037:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854046:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854055:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854074:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854096:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100589.854281:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.854363:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.854372:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f2298288072 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.854387:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.854388:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.854390:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.854478:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1790100589.854478:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.854485:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.854485:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854495:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.854495:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.854499:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.854499:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.854504:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.854504:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854515:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.854515:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854524:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.854524:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854531:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.854536:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.854549:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790100589.861915:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790100589.862030:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100589.862039:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862053:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.862058:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862069:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862103:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862113:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b01a2a56/0xc87a4f2298288080 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862137:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.862142:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862167:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.862170:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862374:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862387:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862394:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f1f4213/0xc87a4f2298288087 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862410:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.862412:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.862415:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.862963:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.862970:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.862981:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.862985:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.863000:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.863012:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.863028:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.863036:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.863050:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.863082:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.863088:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863103:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.863106:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863122:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863136:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863143:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060d48ec8/0xc87a4f229828808e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100589.863249:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.863254:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863263:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.863265:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.863270:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863279:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863300:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863306:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.863314:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100589.864038:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.864046:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864056:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.864060:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864068:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864164:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864240:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b734f7/0xc87a4f2298288095 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864258:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.864266:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.864268:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.864648:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.864655:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864665:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.864668:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.864672:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864682:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864690:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864697:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.864714:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.864984:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.864990:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.865012:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.865015:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.865030:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.865045:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.865051:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051e65296/0xc87a4f229828809c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.865075:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.865082:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.865084:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.866008:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.866022:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.866034:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.866043:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.866058:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.866065:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd1486/0xc87a4f2298288079 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.866083:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.866086:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.866088:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.866110:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.866112:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.866113:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.866400:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.866407:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.866420:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.866424:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.866429:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.866449:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.866459:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.866467:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.866492:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790100589.867046:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.867053:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.867062:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.867065:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.867069:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.867079:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.867086:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.867093:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.867105:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790100589.867320:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100589.867327:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867335:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.867363:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867371:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867397:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867404:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cd4c396/0xc87a4f22982880a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867420:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.867423:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867429:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.867433:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867440:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867449:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867455:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fe6899d/0xc87a4f22982880aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.867468:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.867470:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.867477:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.867484:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.868451:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.868462:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868475:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.868479:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.868485:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868505:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868513:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868521:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868539:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790100589.868737:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.868743:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868750:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.868753:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.868756:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868765:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868772:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868787:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.868811:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790100589.869161:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100589.869181:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869189:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.869193:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869202:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869218:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869226:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9a0e97/0xc87a4f22982880b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869245:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.869249:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869255:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.869258:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869277:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869289:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869296:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb000fc0/0xc87a4f22982880b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.869311:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.869313:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.869314:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.870880:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.871797:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1790100589.871797:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.871808:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.871808:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.871826:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.871826:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.871831:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.871831:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.871837:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.871837:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.871851:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.871851:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.871861:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.871881:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.871897:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.871934:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.871942:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.871958:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790100589.871967:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100589.871973:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.871986:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.871990:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872009:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872026:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872033:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1f4213/0xc87a4f22982880bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872050:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.872053:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872059:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.872062:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872068:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872077:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872090:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.872102:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.872104:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.872105:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.872471:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.873721:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.873732:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.873747:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.873752:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.873758:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.873771:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.873781:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.873794:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.873812:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100589.874657:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.874666:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.874678:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.874682:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.874693:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.874713:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.874721:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ab57303/0xc87a4f22982880cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.874741:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.874742:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.874744:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.875277:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.875284:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875296:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.875300:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.875305:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875316:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875324:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875332:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100589.875363:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.875375:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.875383:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.875386:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.875390:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.875399:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875406:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100589.875408:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.875414:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.875427:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790100589.875514:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100589.875520:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875533:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083927e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.875536:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875544:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875557:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875564:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090a356f1/0xc87a4f22982880d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875578:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.875581:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875588:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.875591:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875598:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875609:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875623:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b5a96d0/0xc87a4f22982880db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.875636:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.875638:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.875640:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.875698:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.876726:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.876736:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.876748:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.876752:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.876757:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.876768:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.876782:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.876790:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.876818:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100589.877018:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.877025:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877034:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.877037:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877046:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877061:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877070:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8e058c/0xc87a4f22982880e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877085:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.877086:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.877088:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.877203:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.877209:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.877219:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.877222:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.877226:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.877236:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.877243:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.877250:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.877270:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100589.877518:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.877524:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877531:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.877535:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877543:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877555:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877561:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b01a2a56/0xc87a4f22982880e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.877573:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.877575:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.877576:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.878086:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.878091:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878101:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.878104:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.878108:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878118:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878126:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878133:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878149:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.878157:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.878162:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878179:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.878183:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878202:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878214:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878221:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b734f7/0xc87a4f22982880f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.878234:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.878236:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.878238:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.878462:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.878468:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.878477:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.878480:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.878484:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.878506:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.878514:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.878521:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.878545:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100589.878785:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.878791:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.878798:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.878802:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.878810:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.878821:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.878827:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d390d5a/0xc87a4f22982880f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.878843:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.878850:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.878852:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790100589.878982:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790100589.878989:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.879006:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790100589.879010:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100589.879014:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.879023:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.879031:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.879048:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.879068:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100589.879364:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.879369:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879376:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ee00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.879379:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879386:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879398:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879405:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000954252b8/0xc87a4f22982880fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879427:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.879429:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.879430:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.879646:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.879652:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879660:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.879663:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.879667:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879677:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879685:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879692:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.879710:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790100589.879712:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.879717:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879724:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.879727:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.879731:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879740:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879748:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879756:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879769:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790100589.879775:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100589.879780:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879786:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083926200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.879789:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879824:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879835:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879841:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6e7b97/0xc87a4f2298288105 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879854:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100589.879857:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879864:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100589.879867:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879874:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879883:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879889:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d23ae309/0xc87a4f229828810c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.879910:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.879912:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.879914:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.881331:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.883284:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.883302:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883369:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.883375:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.883382:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883396:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883406:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883416:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883434:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790100589.883438:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.883444:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.883451:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.883455:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.883458:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.883468:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.883475:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.883482:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.883498:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790100589.883511:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100589.883520:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.883532:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.883583:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.883588:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883597:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686800 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.883601:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883610:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883637:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883646:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b42d173/0xc87a4f229828811a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.883662:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.883664:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.883666:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790100589.883872:0:19357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790100589.883878:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.883899:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1790100589.883902:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100589.883906:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.883915:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.883923:0:19357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.883947:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.883962:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.883976:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.883985:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893228c0/0xc87a4f2298288113 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.884012:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.884014:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.884016:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100589.885282:0:19357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100589.885312:0:19357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790100589.885372:0:19357:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1790100589.885475:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17207:x1877056141049344:12345-0@lo:5:osp-pre-1-0.0 Request processed in 106912us (109367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100589.885484:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790100589.885491:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17207:1877056141049344:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790100589.885509:0:17207:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1790100589.885557:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17207:1877056141051264:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790100589.885592:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100589.885622:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194d10780 going to sleep for 11 seconds 00010000:00010000:1.0:1790100589.885875:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.885883:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.885900:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686a00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.885904:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.885915:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.885946:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.885954:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043033b08/0xc87a4f2298288121 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.885976:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.885978:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.885979:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.886085:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.886092:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886103:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.886106:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.886111:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886122:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886141:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886148:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886162:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790100589.886288:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141051264 00000100:00100000:0.0:1790100589.886297:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141051264 00010000:00010000:2.0:1790100589.886303:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.886308:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886315:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47c00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.886318:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886325:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886354:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886362:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288128 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.886376:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.886384:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.886385:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100589.886958:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790100589.886973:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17207:x1877056141051264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790100589.887023:0:18686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:2.0:1790100589.890729:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.890743:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.890761:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.890767:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.890773:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.890789:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.890799:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.890807:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.890830:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.892769:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.892780:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.892795:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47200 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.892800:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.892811:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.892838:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.892846:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077461768/0xc87a4f229828812f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.892870:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.892872:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.892874:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.894444:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.894456:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.894473:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.894477:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.894482:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.894501:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.894510:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.894517:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.894537:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100589.896063:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100589.896072:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.896083:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100589.896088:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.896097:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.896115:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.896122:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086549a0c/0xc87a4f2298288136 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100589.896152:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.896154:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100589.896156:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790100589.898482:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.898496:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.898513:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.898517:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.898523:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.898537:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.898550:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.898568:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.898586:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790100589.900380:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790100589.900392:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900408:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790100589.900412:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100589.900418:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900429:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900439:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900446:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900468:0:18687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1790100589.900534:0:18687:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1790100589.900618:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17205:x1877056141049472:12345-0@lo:5:osp-pre-0-0.0 Request processed in 121006us (124385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100589.900635:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1790100589.900674:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100589.900681:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900690:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.900695:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900704:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900722:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900730:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090d10b05/0xc87a4f229828813d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900746:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100589.900750:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900756:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47c00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:2.0:1790100589.900760:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900780:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900790:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900797:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa70e699/0xc87a4f2298288144 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100589.900808:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.900809:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100589.900811:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100589.906835:0:17205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17205:1877056141049472:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790100589.906853:0:17205:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1790100589.906905:0:17205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17205:1877056141051392:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790100589.906959:0:17205:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100589.906983:0:17205:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b20933c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790100589.907007:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790100589.907254:0:19501:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1790100589.907292:0:19501:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1790100589.907312:0:19501:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790100589.907745:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141051392 00000100:00100000:0.0:1790100589.907752:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141051392 00000100:00100000:0.0:1790100589.907799:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100589.907808:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17205:x1877056141051392:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790100589.907846:0:19357:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:1.0:1790100589.908121:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17925:x1877056141051136:12345-0@lo:5:osp-pre-1-1.0 Request processed in 80632us (80723us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790100589.908130:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100589.908171:0:17925:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790100589.908178:0:17925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1877056141051136:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1790100589.908189:0:17925:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790100589.908228:0:17925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17925:1877056141051520:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1790100589.908256:0:17925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100589.908274:0:17925:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b20939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100589.908295:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141051520 00000100:00100000:1.0:1790100589.908299:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141051520 00000100:00100000:1.0:1790100589.908325:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100589.908331:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17925:x1877056141051520:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1790100589.908383:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17925:x1877056141051520:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100589.908395:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790100589.908589:0:17925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92608497d880 x1877056141051520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790100605 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100589.908600:0:17925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17925:1877056141051520:0@lo:900:osp-pre-1-1.0 00000001:00080000:0.0:1790100589.914554:0:19501:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1790100589.914749:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17207:x1877056141051264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27777us (29153us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790100589.914759:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790100589.915498:0:17207:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1790100589.915508:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17207:1877056141051264:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790100589.915523:0:17207:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:0.0:1790100589.924163:0:18683:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1790100589.924328:0:18683:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790100589.924600:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17205:x1877056141051392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16786us (17634us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790100589.924612:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100589.924764:0:17205:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1790100589.924773:0:17205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17205:1877056141051392:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790100589.924787:0:17205:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1790100590.346415:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790100590.922101:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790100591.368900:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100592.401128:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100592.709809:0:19859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790100593.416582:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790100593.536198:0:19911:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790100593.537623:0:19911:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790100594.121139:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100594.121160:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141051648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100594.121222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100594.121286:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141051648 00000100:00100000:0.0:1790100594.121294:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141051648 00000100:00100000:0.0:1790100594.121335:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790100594.121381:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141051648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790100594.121413:0:17921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790100594.121452:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141051648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.121467:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790100594.121528:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141051648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100594.124075:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141051776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100594.124139:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100594.124821:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141051776 00000100:00100000:3.0:1790100594.124839:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141051776 00000100:00100000:3.0:1790100594.124894:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790100594.125005:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141051776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100594.125039:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790100594.125108:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141051776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100594.125210:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141051776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100594.129696:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:00000004:0.0:1790100594.404397:0:19961:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790100594.404632:0:19961:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790100594.441542:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100594.634734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100594.634757:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261c1b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141051904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100594.634825:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100594.634918:0:18691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141051904 00000100:00100000:3.0:1790100594.634926:0:18691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141051904 00000100:00100000:3.0:1790100594.634997:0:18691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100594.635007:0:18691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141051904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790100594.635033:0:18691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1790100594.635085:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100594.635093:0:18691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141051904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100594.635100:0:18691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100594.635170:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261c1b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141051904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790100594.666294:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.666470:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127352448 00000100:00100000:0.0:1790100594.666483:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127352448 00000100:00100000:0.0:1790100594.666528:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:0.0:1790100594.666535:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2418:x1877056127352448:12345-192.168.203.13@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790100594.666560:0:17174:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3@192.168.203.13@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:0.0:1790100594.666591:0:17174:0:(genops.c:1384:class_connect()) connect: client 4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3, cookie 0xc87a4f229828814b 00000100:00080000:0.0:1790100594.666723:0:17174:0:(import.c:65:import_set_state_nolock()) ffff9260821cd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100594.666790:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+5:2418:x1877056127352448:12345-192.168.203.13@tcp:250:mount.lustre.0 Request processed in 253us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.666802:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:1.0:1790100594.670541:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.670879:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127352576 00000100:00100000:0.0:1790100594.670888:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127352576 00000100:00100000:0.0:1790100594.671066:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:0.0:1790100594.671076:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+5:14883:x1877056127352576:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790100594.671095:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100594.671113:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926191687c00/0xc87a4f2298288152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4f5 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.671156:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926191687c00/0xc87a4f2298288152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4f5 expref: 6 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.671167:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926191687c00/0xc87a4f2298288152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4f5 expref: 6 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.671455:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191687c00, rc 0) 00000100:00100000:0.0:1790100594.671517:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+6:14883:x1877056127352576:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 442us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.671523:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:1.0:1790100594.675947:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.676470:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127352704 00000100:00100000:0.0:1790100594.676480:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127352704 00000100:00100000:0.0:1790100594.676536:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1790100594.676545:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+6:14883:x1877056127352704:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790100594.676662:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+6:14883:x1877056127352704:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 117us (725us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100594.676670:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1790100594.679657:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.680715:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127352832 00000100:00100000:0.0:1790100594.680728:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127352832 00000100:00100000:0.0:1790100594.680795:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:0.0:1790100594.680814:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+6:14883:x1877056127352832:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790100594.680831:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100594.680847:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926191686400/0xc87a4f2298288159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e4fc expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.680874:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926191686400/0xc87a4f2298288159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4fc expref: 7 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.680917:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926191686400/0xc87a4f2298288159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e4fc expref: 7 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.680927:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191686400, rc 0) 00000100:00100000:0.0:1790100594.681006:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+7:14883:x1877056127352832:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 194us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.681013:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1790100594.689063:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100594.689154:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127352960 00000100:00100000:2.0:1790100594.689165:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127352960 00000100:00100000:2.0:1790100594.689221:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1790100594.689230:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+7:14883:x1877056127352960:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790100594.689432:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14883:x1877056127352960:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 202us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100594.689452:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1790100594.704228:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100594.704386:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127353088 00000100:00100000:1.0:1790100594.704396:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127353088 00000100:00100000:1.0:1790100594.704450:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1790100594.704460:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14883:x1877056127353088:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790100594.704606:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14883:x1877056127353088:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 147us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100594.704614:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1790100594.728296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.728787:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127353216 00000100:00100000:0.0:1790100594.728796:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127353216 00000100:00100000:0.0:1790100594.728850:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1790100594.728860:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14901:x1877056127353216:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100594.729022:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14901:x1877056127353216:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 162us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.729029:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1790100594.758473:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100594.759530:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127353344 00000100:00100000:2.0:1790100594.759541:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127353344 00000100:00100000:2.0:1790100594.759601:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1790100594.759612:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14901:x1877056127353344:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100594.760180:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14901:x1877056127353344:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 567us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100594.760189:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1790100594.775311:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100594.775430:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127353472 00000100:00100000:1.0:1790100594.775440:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127353472 00000100:00100000:1.0:1790100594.775495:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1790100594.775504:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14901:x1877056127353472:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100594.775669:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14901:x1877056127353472:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 165us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100594.775677:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1790100594.780003:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100594.780278:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127353600 00000100:00100000:2.0:1790100594.780289:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127353600 00000100:00100000:2.0:1790100594.780375:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1790100594.780386:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+8:14883:x1877056127353600:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100594.780517:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100594.780537:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083e47e00/0xc87a4f2298288160 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e52d expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100594.780564:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083e47e00/0xc87a4f2298288160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e52d expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100594.780575:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083e47e00/0xc87a4f2298288160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e52d expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100594.780585:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47e00, rc 0) 00000100:00100000:2.0:1790100594.780644:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+9:14883:x1877056127353600:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 259us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100594.780664:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1790100594.786018:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.786173:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127353728 00000100:00100000:0.0:1790100594.786183:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127353728 00000100:00100000:0.0:1790100594.786242:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:0.0:1790100594.786252:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+9:14883:x1877056127353728:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790100594.786277:0:17173:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790100594.786302:0:17173:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790100594.786306:0:17173:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790100594.786309:0:17173:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790100594.786312:0:17173:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790100594.786315:0:17173:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1790100594.790060:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+9:14883:x1877056127353728:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 3792us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.790087:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:2.0:1790100594.794401:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.794606:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127353856 00000100:00100000:0.0:1790100594.794617:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127353856 00000100:00100000:0.0:1790100594.794670:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:0.0:1790100594.794680:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+9:14883:x1877056127353856:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790100594.794695:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100594.794712:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e534 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.794738:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.794750:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100594.794758:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191687600, rc 0) 00000100:00100000:0.0:1790100594.794815:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14883:x1877056127353856:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 136us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.794823:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:3.0:1790100594.798928:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.799208:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127353984 00000100:00100000:0.0:1790100594.799218:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127353984 00000100:00100000:0.0:1790100594.799276:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:0.0:1790100594.799286:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14883:x1877056127353984:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790100594.799474:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14883:x1877056127353984:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 189us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.799481:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:2.0:1790100594.802508:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100594.802815:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127354112 00000100:00100000:1.0:1790100594.802825:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127354112 00000100:00100000:1.0:1790100594.802881:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:1.0:1790100594.802891:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14883:x1877056127354112:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790100594.803065:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14883:x1877056127354112:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 175us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100594.803076:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:1.0:1790100594.810301:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100594.811598:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127354240 00000100:00100000:2.0:1790100594.811611:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127354240 00000100:00100000:2.0:1790100594.811672:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1790100594.811682:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14906:x1877056127354240:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100594.811842:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14906:x1877056127354240:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 161us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100594.811849:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:3.0:1790100594.819846:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.820288:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127354368 00000100:00100000:0.0:1790100594.820298:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127354368 00000100:00100000:0.0:1790100594.820391:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:0.0:1790100594.820401:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14906:x1877056127354368:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100594.820556:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:14906:x1877056127354368:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 155us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.820564:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:3.0:1790100594.824052:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100594.824144:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100594.824550:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127354496 00000100:00100000:1.0:1790100594.824561:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127354496 00000100:00100000:1.0:1790100594.824595:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127354752 00000100:00100000:1.0:1790100594.824598:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127354752 00000100:00100000:1.0:1790100594.824612:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790100594.824621:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2418:x1877056127354496:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790100594.824650:0:17180:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 04100da5-99d0-41db-b436-f542c1b00474@192.168.203.13@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:1.0:1790100594.824700:0:17180:0:(genops.c:1384:class_connect()) connect: client 04100da5-99d0-41db-b436-f542c1b00474, cookie 0xc87a4f229828816e 00000004:00100000:1.0:1790100594.824724:0:17180:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790100594.824938:0:17180:0:(import.c:65:import_set_state_nolock()) ffff9261a631f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100594.825245:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+6:2418:x1877056127354496:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 623us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100594.825253:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790100594.825285:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790100594.825291:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2418:x1877056127354752:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790100594.825308:0:17180:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 04100da5-99d0-41db-b436-f542c1b00474@192.168.203.13@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:1.0:1790100594.825372:0:17180:0:(genops.c:1384:class_connect()) connect: client 04100da5-99d0-41db-b436-f542c1b00474, cookie 0xc87a4f2298288175 00000004:00100000:1.0:1790100594.825386:0:17180:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790100594.825537:0:17180:0:(import.c:65:import_set_state_nolock()) ffff926083876000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100594.825566:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+6:2418:x1877056127354752:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 274us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100594.825572:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790100594.836539:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100594.836575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100594.836619:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.838036:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127355008 00000100:00100000:0.0:1790100594.838048:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127355008 00000100:00100000:0.0:1790100594.838112:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127354880 00000100:00100000:0.0:1790100594.838116:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127354880 00000100:00100000:0.0:1790100594.838129:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127354624 00000100:00100000:0.0:1790100594.838132:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127354624 00000100:00100000:0.0:1790100594.838149:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790100594.838158:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+7:14883:x1877056127355008:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790100594.838193:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790100594.838292:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+7:14883:x1877056127355008:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 133us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.838300:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790100594.838318:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790100594.838325:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+6:0:x1877056127354880:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790100594.838358:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1790100594.838609:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100594.838614:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100594.840217:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+6:0:x1877056127354880:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 1884us (3632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.840228:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790100594.840257:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1790100594.840277:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+6:0:x1877056127354624:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790100594.840301:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790100594.840329:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+6:0:x1877056127354624:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 53us (3709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.840334:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1790100594.852266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100594.852381:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127355136 00000100:00100000:3.0:1790100594.852401:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127355136 00000100:00100000:3.0:1790100594.852463:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1790100594.852473:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+6:14883:x1877056127355136:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790100594.852565:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+6:14883:x1877056127355136:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100594.852573:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1790100594.864635:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100594.864678:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100594.864712:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100594.864803:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127355520 00000100:00100000:1.0:1790100594.864812:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127355520 00000100:00100000:1.0:1790100594.864871:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1790100594.864881:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:04100da5-99d0-41db-b436-f542c1b00474+6:14883:x1877056127355520:12345-192.168.203.13@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790100594.864980:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:04100da5-99d0-41db-b436-f542c1b00474+6:14883:x1877056127355520:12345-192.168.203.13@tcp:900:mount.lustre.0 Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100594.864988:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1790100594.865142:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127355264 00000100:00100000:0.0:1790100594.865147:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127355264 00000100:00100000:0.0:1790100594.865175:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127355392 00000100:00100000:0.0:1790100594.865179:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127355392 00000100:00100000:0.0:1790100594.865193:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790100594.865199:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2418:x1877056127355264:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790100594.865224:0:18688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 04100da5-99d0-41db-b436-f542c1b00474@192.168.203.13@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1790100594.865251:0:18688:0:(genops.c:1384:class_connect()) connect: client 04100da5-99d0-41db-b436-f542c1b00474, cookie 0xc87a4f229828817c 00002000:00100000:0.0:1790100594.865263:0:18688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 04100da5-99d0-41db-b436-f542c1b00474/ffff9260821ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790100594.865274:0:18688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790100594.865501:0:18688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790100594.865529:0:18688:0:(import.c:65:import_set_state_nolock()) ffff9260821c8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100594.865568:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04100da5-99d0-41db-b436-f542c1b00474+6:2418:x1877056127355264:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 368us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.865576:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790100594.865591:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1790100594.865595:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2418:x1877056127355392:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790100594.865611:0:18688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 04100da5-99d0-41db-b436-f542c1b00474@192.168.203.13@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1790100594.865626:0:18688:0:(genops.c:1384:class_connect()) connect: client 04100da5-99d0-41db-b436-f542c1b00474, cookie 0xc87a4f2298288183 00002000:00100000:0.0:1790100594.865631:0:18688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 04100da5-99d0-41db-b436-f542c1b00474/ffff9260821cf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790100594.865649:0:18688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790100594.865763:0:18688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790100594.865778:0:18688:0:(import.c:65:import_set_state_nolock()) ffff9260821cb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100594.865802:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04100da5-99d0-41db-b436-f542c1b00474+6:2418:x1877056127355392:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 204us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100594.865809:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1790100594.872537:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100594.872711:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127355648 00000100:00100000:0.0:1790100594.872721:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127355648 00000100:00100000:0.0:1790100594.872822:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790100594.872833:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04100da5-99d0-41db-b436-f542c1b00474+6:14883:x1877056127355648:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00080000:3.0:1790100594.875035:0:17183:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2100us 00000004:00200000:3.0:1790100594.891674:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790100594.891798:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04100da5-99d0-41db-b436-f542c1b00474+6:14883:x1877056127355648:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 18962us (19265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100594.891813:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790100595.016470:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100595.016578:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127355776 00000100:00100000:2.0:1790100595.016592:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127355776 00000100:00100000:2.0:1790100595.016648:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1790100595.016658:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+6:14929:x1877056127355776:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:2.0:1790100595.016676:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100595.016699:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828818a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e565 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.016852:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288191 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.016927:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.016965:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100595.017017:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790100595.017022:0:17182:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100595.017058:0:17182:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.017084:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828818a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e565 expref: 8 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.017101:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e565 expref: 7 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.017108:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b100) 00010000:00010000:2.0:1790100595.017111:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100595.017114:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:2.0:1790100595.017215:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+7:14929:x1877056127355776:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 558us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.017222:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1790100595.144583:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790100595.144605:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141052160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100595.144681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.144739:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141052032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100595.144783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100595.144997:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141052160 00000100:00100000:0.0:1790100595.145005:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141052160 00000100:00100000:0.0:1790100595.145053:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141052032 00000100:00100000:0.0:1790100595.145056:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141052032 00000100:00100000:0.0:1790100595.145075:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1790100595.145080:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100595.145086:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141052160:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790100595.145088:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1790100595.145111:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790100595.145160:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141052160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100595.145168:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100595.145183:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790100595.145188:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141052032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100595.145197:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790100595.145239:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141052160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100595.145394:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141052288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100595.145606:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141052544:0@lo:400:kworker.0 00000100:00100000:3.0:1790100595.145693:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141052416:0@lo:400:kworker.0 00000100:00100000:0.0:1790100595.149697:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141052032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4500us (4905us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100595.150223:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.150285:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141052032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100595.150318:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141052800:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.150367:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.150390:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056141053312:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.150435:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.150463:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790100595.150470:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056141052672:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.150491:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.150510:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056141053184:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.150528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.150544:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056141053696:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.150566:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.150596:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141052800 00000100:00100000:1.0:1790100595.150603:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141052800 00000100:00100000:1.0:1790100595.150651:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790100595.150659:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141052800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100595.150712:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141053312 00000100:00100000:2.0:1790100595.150718:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141053312 00000100:00100000:2.0:1790100595.150750:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141052672 00000100:00100000:2.0:1790100595.150753:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141052672 00000100:00100000:2.0:1790100595.150764:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141053184 00000100:00100000:2.0:1790100595.150766:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141053184 00000100:00100000:2.0:1790100595.150775:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141053696 00000100:00100000:2.0:1790100595.150783:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141053696 00000100:00100000:2.0:1790100595.150800:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100595.150806:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056141053312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100595.150847:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056141053312:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.150854:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100595.150870:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790100595.150876:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056141052672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100595.150901:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056141052672:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.150907:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790100595.150917:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790100595.150923:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056141053184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100595.150947:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877056141053184:12345-0@lo:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.150952:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790100595.150975:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790100595.150981:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056141053696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100595.151006:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056141053696:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.151011:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100595.151045:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141052800:12345-0@lo:400:kworker.0 Request processed in 386us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.151056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.151067:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790100595.151086:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141052544 00000100:00100000:1.0:1790100595.151090:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141052544 00000100:00100000:2.0:1790100595.151110:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141053056:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.151118:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790100595.151127:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141052544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100595.151141:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100595.151170:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056141053568:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.151176:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141052544:12345-0@lo:400:kworker.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100595.151185:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1790100595.151207:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790100595.151211:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100595.151217:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100595.151229:0:18691:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1790100595.151237:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141053568 00000100:00100000:1.0:1790100595.151238:0:18691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1790100595.151243:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141053568 00000100:00100000:2.0:1790100595.151271:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790100595.151277:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056141053568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100595.151317:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056141053568:12345-0@lo:400:kworker.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00080000:1.0:1790100595.151322:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100595.151326:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790100595.151373:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056141053568:0@lo:400:kworker.0 00000100:00100000:2.0:1790100595.151390:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141052544:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.151435:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056141052672:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.151445:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877056141053184:0@lo:400:kworker.0 00010000:00080000:1.0:1790100595.151456:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c0380 x1877056141053696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100595.151466:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056141053696:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.151476:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141052800:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.151488:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056141053312:0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.151542:0:18691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141052288 00000100:00100000:1.0:1790100595.151547:0:18691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141052288 00000100:00080000:1.0:1790100595.151577:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100595.151599:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790100595.151621:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100595.151630:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141052288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100595.151648:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790100595.151694:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141052288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100595.151701:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100595.151731:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141052288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100595.151939:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141053056 00000100:00100000:1.0:1790100595.151944:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141053056 00000100:00100000:1.0:1790100595.152076:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100595.152083:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141053056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.152131:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141053056:12345-0@lo:400:kworker.0 Request processed in 49us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100595.152138:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100595.153217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100595.153268:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141052928:0@lo:400:kworker.0 00000100:00100000:3.0:1790100595.153299:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100595.153329:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141053440:0@lo:400:kworker.0 00000100:00100000:3.0:1790100595.153377:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100595.153389:0:19675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141052928 00000100:00100000:0.0:1790100595.153397:0:19675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141052928 00000100:00100000:3.0:1790100595.153405:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141053440 00000100:00100000:3.0:1790100595.153411:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141053440 00000100:00100000:0.0:1790100595.153448:0:19675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100595.153458:0:19675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141052928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100595.153459:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100595.153472:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100595.153511:0:19675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141052928:12345-0@lo:400:kworker.0 Request processed in 55us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100595.153520:0:19675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100595.153521:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1877056141053440:12345-0@lo:400:kworker.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100595.153531:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1790100595.153556:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100595.153605:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141052416 00000100:00100000:1.0:1790100595.153610:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141052416 00000100:00100000:1.0:1790100595.153662:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790100595.153672:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:3643:x1877056141052416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100595.153709:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:3643:x1877056141052416:12345-0@lo:400:kworker.0 Request processed in 40us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100595.153715:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790100595.154725:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141053056:0@lo:400:kworker.0 00010000:00080000:3.0:1790100595.154837:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261a62c2680 x1877056141053440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100595.154863:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1877056141053440:0@lo:400:kworker.0 00000100:00100000:3.0:1790100595.154883:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141052416:0@lo:400:kworker.0 00000100:00100000:3.0:1790100595.154893:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141052928:0@lo:400:kworker.0 00010000:00010000:2.0:1790100595.464822:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100596.489529:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790100596.683433:0:19501:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 04100da5-99d0-41db-b436-f542c1b00474 00000001:00100000:0.0:1790100596.686937:0:18683:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 04100da5-99d0-41db-b436-f542c1b00474 00000040:00080000:3.0:1790100597.001649:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790100597.041184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100597.041271:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127355904 00000100:00100000:1.0:1790100597.041282:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127355904 00000100:00100000:1.0:1790100597.041382:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1790100597.041392:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+7:14981:x1877056127355904:12345-192.168.203.13@tcp:41:lfs.0 00000004:00000024:1.0:1790100597.041430:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790100597.041523:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+7:14981:x1877056127355904:12345-192.168.203.13@tcp:41:lfs.0 Request processed in 132us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100597.041531:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00080000:0.0:1790100597.041638:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100597.044434:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.045094:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127356032 00000100:00100000:0.0:1790100597.045105:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127356032 00000100:00100000:0.0:1790100597.045243:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1790100597.045255:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+6:14981:x1877056127356032:12345-192.168.203.13@tcp:41:lfs.0 00000004:00000024:0.0:1790100597.045293:0:17181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790100597.045449:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+6:14981:x1877056127356032:12345-192.168.203.13@tcp:41:lfs.0 Request processed in 196us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.045474:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00080000:1.0:1790100597.046025:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790100597.052748:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100597.052979:0:18691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127356160 00000100:00100000:1.0:1790100597.052989:0:18691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127356160 00000100:00100000:1.0:1790100597.053065:0:18691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790100597.053075:0:18691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:04100da5-99d0-41db-b436-f542c1b00474+5:14981:x1877056127356160:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:1.0:1790100597.053126:0:18691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790100597.053250:0:18691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:04100da5-99d0-41db-b436-f542c1b00474+5:14981:x1877056127356160:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 176us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100597.053258:0:18691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:0.0:1790100597.053385:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100597.055829:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.060640:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127356288 00000100:00100000:0.0:1790100597.060656:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127356288 00000100:00080000:1.0:1790100597.062609:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100597.062616:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790100597.062629:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:04100da5-99d0-41db-b436-f542c1b00474+5:14981:x1877056127356288:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:0.0:1790100597.062664:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790100597.063336:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:04100da5-99d0-41db-b436-f542c1b00474+5:14981:x1877056127356288:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 707us (7511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.063366:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1790100597.285109:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100597.286789:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127356416 00000100:00100000:2.0:1790100597.286804:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127356416 00000100:00100000:2.0:1790100597.286926:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1790100597.286946:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+10:15013:x1877056127356416:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100597.286964:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100597.286982:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083e47600/0xc87a4f2298288198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e56c expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100597.287012:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083e47600/0xc87a4f2298288198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e56c expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100597.287042:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083e47600/0xc87a4f2298288198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e56c expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100597.287051:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47600, rc 0) 00000100:00100000:2.0:1790100597.287117:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15013:x1877056127356416:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 181us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.287124:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1790100597.304318:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100597.304483:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127356544 00000100:00100000:1.0:1790100597.304494:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127356544 00000100:00100000:1.0:1790100597.304549:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:1.0:1790100597.304561:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15013:x1877056127356544:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790100597.304744:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15013:x1877056127356544:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 184us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100597.304753:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:3.0:1790100597.313285:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100597.313598:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127356672 00000100:00100000:2.0:1790100597.313610:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127356672 00000100:00100000:2.0:1790100597.313666:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:2.0:1790100597.313675:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c20c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15013:x1877056127356672:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790100597.313823:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c20c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15013:x1877056127356672:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 148us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.313838:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:3.0:1790100597.317633:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.317805:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127356800 00000100:00100000:0.0:1790100597.317814:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127356800 00000100:00100000:0.0:1790100597.317884:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1790100597.317894:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15021:x1877056127356800:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100597.318053:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15021:x1877056127356800:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 160us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.318060:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1790100597.352755:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100597.353607:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127356928 00000100:00100000:1.0:1790100597.353617:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127356928 00000100:00100000:1.0:1790100597.353680:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:1.0:1790100597.353689:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15021:x1877056127356928:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100597.354268:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15021:x1877056127356928:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 577us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100597.354278:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:3.0:1790100597.359670:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100597.359740:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127357056 00000100:00100000:2.0:1790100597.359750:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127357056 00000100:00100000:2.0:1790100597.359858:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:2.0:1790100597.359871:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15021:x1877056127357056:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100597.360033:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15021:x1877056127357056:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 164us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.360041:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:3.0:1790100597.365454:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100597.365511:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127357184 00000100:00100000:1.0:1790100597.365522:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127357184 00000100:00100000:1.0:1790100597.365570:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:1.0:1790100597.365580:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:15013:x1877056127357184:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790100597.365596:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100597.365613:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926184b8f200/0xc87a4f229828819f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e59d expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100597.365652:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926184b8f200/0xc87a4f229828819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e59d expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100597.365663:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926184b8f200/0xc87a4f229828819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e59d expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100597.365672:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8f200, rc 0) 00000100:00100000:1.0:1790100597.365728:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:15013:x1877056127357184:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 150us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100597.365735:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:3.0:1790100597.372642:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100597.372720:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127357312 00000100:00100000:2.0:1790100597.372730:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127357312 00000100:00100000:2.0:1790100597.372848:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:2.0:1790100597.372872:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:15013:x1877056127357312:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790100597.372917:0:17175:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790100597.372945:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790100597.372951:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790100597.372953:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790100597.372956:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790100597.372958:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1790100597.378533:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:15013:x1877056127357312:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 5652us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.378548:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:3.0:1790100597.384698:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.387047:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127357440 00000100:00100000:0.0:1790100597.387061:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127357440 00000100:00100000:0.0:1790100597.387133:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:0.0:1790100597.387145:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:15013:x1877056127357440:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790100597.387161:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100597.387178:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e5a4 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.387245:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 13 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.387256:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 13 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.387266:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191687e00, rc 0) 00000100:00100000:0.0:1790100597.387331:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15013:x1877056127357440:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 189us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.387375:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:3.0:1790100597.393263:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100597.393445:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127357568 00000100:00100000:2.0:1790100597.393456:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127357568 00000100:00100000:2.0:1790100597.393511:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:2.0:1790100597.393522:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15013:x1877056127357568:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790100597.393749:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15013:x1877056127357568:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 228us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.393757:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:3.0:1790100597.397069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.397259:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127357696 00000100:00100000:0.0:1790100597.397269:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127357696 00000100:00100000:0.0:1790100597.397328:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1790100597.397566:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15013:x1877056127357696:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790100597.397711:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15013:x1877056127357696:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 373us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.397720:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:3.0:1790100597.401196:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100597.401595:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127357824 00000100:00100000:1.0:1790100597.401604:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127357824 00000100:00100000:1.0:1790100597.401655:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:1.0:1790100597.401664:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15026:x1877056127357824:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100597.401809:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15026:x1877056127357824:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 145us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100597.401817:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:3.0:1790100597.406416:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.408013:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127357952 00000100:00100000:0.0:1790100597.408026:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127357952 00000100:00100000:0.0:1790100597.408090:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:0.0:1790100597.408100:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15026:x1877056127357952:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100597.408255:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:15026:x1877056127357952:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 156us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.408262:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:3.0:1790100597.416682:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100597.416777:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.417046:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127358080 00000100:00100000:0.0:1790100597.417074:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127358080 00000100:00100000:0.0:1790100597.417124:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127358336 00000100:00100000:0.0:1790100597.417127:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127358336 00000100:00100000:0.0:1790100597.417143:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790100597.417153:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2418:x1877056127358080:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790100597.417184:0:17181:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9ceeef86-d61d-43f2-a898-ec1ecb26226c@192.168.203.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1790100597.417226:0:17181:0:(genops.c:1384:class_connect()) connect: client 9ceeef86-d61d-43f2-a898-ec1ecb26226c, cookie 0xc87a4f22982881ad 00000004:00100000:0.0:1790100597.417256:0:17181:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790100597.417403:0:17181:0:(import.c:65:import_set_state_nolock()) ffff9261b657f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100597.417471:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2418:x1877056127358080:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 318us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.417478:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790100597.417495:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1790100597.417499:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2418:x1877056127358336:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790100597.417514:0:17181:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 9ceeef86-d61d-43f2-a898-ec1ecb26226c@192.168.203.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1790100597.417553:0:17181:0:(genops.c:1384:class_connect()) connect: client 9ceeef86-d61d-43f2-a898-ec1ecb26226c, cookie 0xc87a4f22982881b4 00000004:00100000:0.0:1790100597.417567:0:17181:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790100597.417611:0:17181:0:(import.c:65:import_set_state_nolock()) ffff9261b657e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100597.417639:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2418:x1877056127358336:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 137us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.417645:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1790100597.423334:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100597.423400:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100597.423437:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100597.423526:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127358592 00000100:00100000:2.0:1790100597.423535:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127358592 00000100:00100000:2.0:1790100597.423601:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127358464 00000100:00100000:2.0:1790100597.423605:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127358464 00000100:00100000:2.0:1790100597.423618:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127358208 00000100:00100000:2.0:1790100597.423620:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127358208 00000100:00100000:2.0:1790100597.423633:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1790100597.423642:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+7:15013:x1877056127358592:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790100597.423673:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790100597.423739:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+7:15013:x1877056127358592:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 97us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.423758:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1790100597.423776:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1790100597.423783:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:0:x1877056127358464:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790100597.423794:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790100597.423823:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:0:x1877056127358464:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.423829:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1790100597.423841:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1790100597.423848:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:0:x1877056127358208:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790100597.423857:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790100597.423888:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:0:x1877056127358208:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 41us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.423894:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00080000:3.0:1790100597.424250:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790100597.424255:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100597.433676:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100597.433825:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127358720 00000100:00100000:2.0:1790100597.433836:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127358720 00000100:00100000:2.0:1790100597.433987:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1790100597.433998:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261c1b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15013:x1877056127358720:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790100597.434082:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261c1b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15013:x1877056127358720:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 86us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.434090:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1790100597.438945:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.439090:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127358848 00000100:00100000:0.0:1790100597.439101:0:18687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127358848 00000100:00100000:0.0:1790100597.439149:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1790100597.439157:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2418:x1877056127358848:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790100597.439190:0:18687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9ceeef86-d61d-43f2-a898-ec1ecb26226c@192.168.203.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1790100597.439229:0:18687:0:(genops.c:1384:class_connect()) connect: client 9ceeef86-d61d-43f2-a898-ec1ecb26226c, cookie 0xc87a4f22982881bb 00002000:00100000:0.0:1790100597.439239:0:18687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9ceeef86-d61d-43f2-a898-ec1ecb26226c/ffff9261b657b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790100597.439250:0:18687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790100597.439372:0:18687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790100597.439402:0:18687:0:(import.c:65:import_set_state_nolock()) ffff9261b657f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100597.439464:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2418:x1877056127358848:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 307us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.439472:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1790100597.441803:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100597.441857:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.441917:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127358976 00000100:00100000:0.0:1790100597.441926:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127358976 00000100:00100000:1.0:1790100597.441970:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127359104 00000100:00100000:1.0:1790100597.441976:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127359104 00000100:00100000:0.0:1790100597.441987:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1790100597.441995:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2418:x1877056127358976:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790100597.442027:0:18688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9ceeef86-d61d-43f2-a898-ec1ecb26226c@192.168.203.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000100:00100000:1.0:1790100597.442033:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1790100597.442043:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15013:x1877056127359104:12345-192.168.203.13@tcp:900:mount.lustre.0 00000020:00000080:0.0:1790100597.442059:0:18688:0:(genops.c:1384:class_connect()) connect: client 9ceeef86-d61d-43f2-a898-ec1ecb26226c, cookie 0xc87a4f22982881c2 00002000:00100000:0.0:1790100597.442071:0:18688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9ceeef86-d61d-43f2-a898-ec1ecb26226c/ffff9261b6578800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790100597.442080:0:18688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1790100597.442120:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15013:x1877056127359104:12345-192.168.203.13@tcp:900:mount.lustre.0 Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100597.442128:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00002000:00080000:0.0:1790100597.442161:0:18688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790100597.442184:0:18688:0:(import.c:65:import_set_state_nolock()) ffff9261b657e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100597.442209:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2418:x1877056127358976:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 215us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.442216:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1790100597.460176:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100597.460287:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127359232 00000100:00100000:1.0:1790100597.460305:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127359232 00000100:00100000:1.0:1790100597.460390:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1790100597.460400:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15013:x1877056127359232:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790100597.460483:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790100597.460567:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15013:x1877056127359232:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 168us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100597.460575:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00010000:00010000:1.0:1790100597.512561:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100597.695710:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100597.695808:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127359360 00000100:00100000:0.0:1790100597.695819:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127359360 00000100:00100000:0.0:1790100597.695888:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1790100597.695924:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15049:x1877056127359360:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:0.0:1790100597.695953:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100597.695977:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191687a00/0xc87a4f22982881c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e5d5 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.696049:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.696063:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.696075:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100597.696492:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790100597.696497:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100597.696524:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.696551:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191687a00/0xc87a4f22982881c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.696569:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100597.696576:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b100) 00010000:00010000:0.0:1790100597.696579:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100597.696583:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191686e00, rc 0) 00000100:00100000:0.0:1790100597.696685:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+7:15049:x1877056127359360:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 763us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100597.696703:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00010000:00010000:2.0:1790100598.537575:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100599.240757:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141053824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100599.240822:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100599.240932:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141053824 00000100:00100000:3.0:1790100599.240940:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141053824 00000100:00100000:3.0:1790100599.240991:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790100599.241001:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141053824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100599.241033:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790100599.241134:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141053824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100599.241141:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790100599.241223:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141053824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790100599.243260:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100599.243278:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a62c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141053952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790100599.243355:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100599.243418:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141053952 00000100:00100000:2.0:1790100599.243425:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141053952 00000100:00100000:2.0:1790100599.243465:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100599.243473:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141053952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100599.243502:0:17921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790100599.243541:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141053952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100599.243547:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100599.243588:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a62c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141053952:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790100599.560711:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100599.752799:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141054080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100599.752932:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100599.753079:0:19974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141054080 00000100:00100000:1.0:1790100599.753087:0:19974:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141054080 00000100:00100000:1.0:1790100599.753167:0:19974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100599.753188:0:19974:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141054080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790100599.753219:0:19974:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1790100599.753292:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100599.753780:0:19974:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141054080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 603us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100599.753790:0:19974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790100599.753884:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141054080:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1790100600.138027:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790100600.264787:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141054208:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.264857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.264904:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141054720:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.264940:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.264962:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141055232:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.264981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265058:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790100600.265065:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141054336:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265122:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141054848:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265159:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056141055360:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265233:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141054592:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265254:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265271:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056141055104:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265289:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265299:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141055616:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265318:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265329:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790100600.265334:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141054464:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265377:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265393:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141054976:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265412:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265428:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056141055488:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265445:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100600.265480:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141054720 00000100:00100000:2.0:1790100600.265487:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141054720 00000100:00100000:2.0:1790100600.265525:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141055232 00000100:00100000:2.0:1790100600.265527:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141055232 00000100:00100000:2.0:1790100600.265550:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141055360 00000100:00100000:2.0:1790100600.265553:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141055360 00000100:00100000:2.0:1790100600.265563:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141055104 00000100:00100000:2.0:1790100600.265565:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141055104 00000100:00100000:2.0:1790100600.265574:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141055616 00000100:00100000:2.0:1790100600.265576:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141055616 00000100:00100000:2.0:1790100600.265587:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141055488 00000100:00100000:2.0:1790100600.265589:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141055488 00000100:00100000:2.0:1790100600.265603:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100600.265610:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141054720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265669:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877056141054720:12345-0@lo:400:kworker.0 Request processed in 59us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.265676:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100600.265693:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100600.265700:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141055232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265724:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877056141055232:12345-0@lo:400:kworker.0 Request processed in 25us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.265730:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100600.265741:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790100600.265747:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056141055360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265772:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877056141055360:12345-0@lo:400:kworker.0 Request processed in 26us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.265778:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790100600.265788:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790100600.265794:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056141055104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265822:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056141055104:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.265827:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790100600.265838:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790100600.265843:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056141055616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265867:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056141055616:12345-0@lo:400:kworker.0 Request processed in 24us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.265873:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790100600.265883:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790100600.265888:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056141055488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.265932:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1877056141055488:12345-0@lo:400:kworker.0 Request processed in 43us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.265938:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790100600.265961:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141054336 00000100:00100000:2.0:1790100600.265964:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141054336 00000100:00100000:2.0:1790100600.265987:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141054848 00000100:00100000:2.0:1790100600.265990:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141054848 00000100:00100000:2.0:1790100600.266002:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100600.266008:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141054336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266037:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141054336:12345-0@lo:400:kworker.0 Request processed in 29us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.266042:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100600.266054:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790100600.266059:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266084:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141054848:12345-0@lo:400:kworker.0 Request processed in 25us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.266089:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790100600.266114:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141054592 00000100:00100000:2.0:1790100600.266118:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141054592 00000100:00100000:2.0:1790100600.266140:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141054464 00000100:00100000:2.0:1790100600.266143:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141054464 00000100:00100000:2.0:1790100600.266161:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141054976 00000100:00100000:2.0:1790100600.266164:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141054976 00000100:00100000:2.0:1790100600.266177:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100600.266182:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141054592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266210:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141054592:12345-0@lo:400:kworker.0 Request processed in 29us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.266215:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100600.266233:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100600.266238:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141054464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266279:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141054464:12345-0@lo:400:kworker.0 Request processed in 41us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.266285:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100600.266296:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790100600.266302:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a62c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141054976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266327:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a62c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1877056141054976:12345-0@lo:400:kworker.0 Request processed in 25us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100600.266332:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1790100600.266373:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100600.266377:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100600.266380:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790100600.266382:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100600.266415:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141054464:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266426:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1877056141054976:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1877056141055488:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266442:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141054592:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266449:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056141055104:0@lo:400:kworker.0 00010000:00080000:2.0:1790100600.266459:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926084837800 x1877056141055616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100600.266468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141055616:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266504:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141054336:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141054848:0@lo:400:kworker.0 00010000:00080000:2.0:1790100600.266535:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff926084837b80 x1877056141055360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100600.266544:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1877056141055360:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266553:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877056141054720:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.266562:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1877056141055232:0@lo:400:kworker.0 00000100:00100000:3.0:1790100600.266707:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141054208 00000100:00100000:3.0:1790100600.266711:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141054208 00000100:00100000:3.0:1790100600.266777:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790100600.266785:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:3641:x1877056141054208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100600.266830:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:3641:x1877056141054208:12345-0@lo:400:kworker.0 Request processed in 47us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100600.266837:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790100600.267023:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100600.267034:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92608497df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141055744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100600.267066:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100600.267097:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141055744 00000100:00100000:1.0:1790100600.267101:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141055744 00000100:00100000:1.0:1790100600.267128:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100600.267135:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141055744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790100600.267165:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790100600.267202:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141055744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100600.267208:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100600.267242:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92608497df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141055744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100600.267485:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141056000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100600.267513:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100600.267579:0:19974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141056000 00000100:00100000:3.0:1790100600.267583:0:19974:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141056000 00000100:00100000:3.0:1790100600.267612:0:19974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100600.267618:0:19974:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141056000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100600.267629:0:19974:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790100600.267661:0:19974:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141056000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100600.267673:0:19974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790100600.267741:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141056000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100600.268132:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141055872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100600.268162:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100600.268253:0:18691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141055872 00000100:00100000:0.0:1790100600.268257:0:18691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141055872 00000100:00100000:0.0:1790100600.268293:0:18691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790100600.268300:0:18691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92608497df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141055872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100600.268313:0:18691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790100600.268379:0:18691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92608497df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141055872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100600.268385:0:18691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100600.268469:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141054208:0@lo:400:kworker.0 00000100:00100000:2.0:1790100600.272299:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141055872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790100600.584735:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100600.672570:0:20060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1790100600.780837:0:17160:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9ceeef86-d61d-43f2-a898-ec1ecb26226c 00000001:00100000:2.0:1790100600.780861:0:17160:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 04100da5-99d0-41db-b436-f542c1b00474 00000001:00100000:0.0:1790100600.784023:0:17913:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9ceeef86-d61d-43f2-a898-ec1ecb26226c 00000001:00100000:0.0:1790100600.784036:0:17913:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 04100da5-99d0-41db-b436-f542c1b00474 00010000:00010000:1.0:1790100601.608707:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100602.637685:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100602.721865:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.721913:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.721941:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.721962:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.721992:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.722013:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.722033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.722052:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.722078:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100602.722107:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127359744 00000100:00100000:2.0:1790100602.722117:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127359744 00000100:00100000:2.0:1790100602.722165:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127360256 00000100:00100000:2.0:1790100602.722168:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127360256 00000100:00100000:2.0:1790100602.722195:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127359616 00000100:00100000:2.0:1790100602.722198:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127359616 00000100:00100000:2.0:1790100602.722211:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127360128 00000100:00100000:2.0:1790100602.722213:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127360128 00000100:00100000:2.0:1790100602.722232:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790100602.722242:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2421:x1877056127359744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100602.722317:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2421:x1877056127359744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100602.722325:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790100602.722376:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1790100602.722391:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2421:x1877056127360256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100602.722415:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2421:x1877056127360256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100602.722420:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1790100602.722431:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1790100602.722436:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+6:2421:x1877056127359616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100602.722823:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+6:2421:x1877056127359616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 385us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100602.722891:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1790100602.722919:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1790100602.722928:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2421:x1877056127360128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100602.722955:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2421:x1877056127360128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100602.722960:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1790100602.723076:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127359488 00000100:00100000:1.0:1790100602.723081:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127359488 00000100:00100000:1.0:1790100602.723114:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:1.0:1790100602.723120:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:2421:x1877056127359488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100602.723145:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:2421:x1877056127359488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100602.723151:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:2.0:1790100602.723558:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127360000 00000100:00100000:2.0:1790100602.723570:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127360000 00000100:00100000:2.0:1790100602.723599:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127360512 00000100:00100000:2.0:1790100602.723602:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127360512 00000100:00100000:2.0:1790100602.723612:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127359872 00000100:00100000:2.0:1790100602.723615:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127359872 00000100:00100000:2.0:1790100602.723625:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127360384 00000100:00100000:2.0:1790100602.723627:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127360384 00000100:00100000:2.0:1790100602.723640:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790100602.723645:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2421:x1877056127360000:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100602.723675:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2421:x1877056127360000:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100602.723681:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790100602.723694:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790100602.724070:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790100602.724079:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04100da5-99d0-41db-b436-f542c1b00474+5:2421:x1877056127359872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100602.724106:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04100da5-99d0-41db-b436-f542c1b00474+5:2421:x1877056127359872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100602.724112:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790100602.724124:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1790100602.724129:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2421:x1877056127360384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100602.724146:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2421:x1877056127360384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 17us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100602.724160:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790100602.724663:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2421:x1877056127360512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100602.724693:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2421:x1877056127360512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 993us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100602.725373:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00080000:2.0:1790100602.725558:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100602.725564:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100602.725567:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100602.725569:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1790100603.659546:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790100603.850626:0:18683:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ceeef86-d61d-43f2-a898-ec1ecb26226c 00000001:00100000:1.0:1790100603.853876:0:19501:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ceeef86-d61d-43f2-a898-ec1ecb26226c 00000020:00000080:2.0:1790100604.059842:0:20207:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcad52b10 20000000:00000080:2.0:1790100604.059936:0:20207:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff926193d25c00 uarg=0000000000000000 20000000:01000000:2.0:1790100604.059976:0:20207:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790100604.059981:0:20207:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790100604.059986:0:20207:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790100604.061063:0:20208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790100604.061246:0:20207:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790100604.071647:0:20207:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790100604.071836:0:20207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071866:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071877:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071885:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071900:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071909:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071917:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071924:0:20207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071969:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.071983:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 12 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.072006:0:20207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056128:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100604.072106:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.072115:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 12 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.072123:0:20207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056256:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100604.072148:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.072156:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 23 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.072165:0:20207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084836d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056384:0@lo:104: 00000100:00100000:3.0:1790100604.072200:0:20207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100604.072237:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.072244:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 23 pid: 17174 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.072251:0:20207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084835f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056512:0@lo:104: 00000100:00100000:3.0:1790100604.072270:0:20207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100604.072295:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.072304:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 23 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.072320:0:20207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056640:0@lo:104: 00000100:00100000:3.0:1790100604.072364:0:20207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100604.072381:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.072389:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 23 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.072396:0:20207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056768:0@lo:104: 00000100:00100000:3.0:1790100604.072412:0:20207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100604.072420:0:20207:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261901d59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100604.072529:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141056384 00000100:00100000:2.0:1790100604.072537:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141056384 00000100:00100000:2.0:1790100604.072575:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141056512 00000100:00100000:2.0:1790100604.072578:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141056512 00000100:00100000:2.0:1790100604.072588:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141056640 00000100:00100000:2.0:1790100604.072590:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141056640 00000100:00100000:2.0:1790100604.072599:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141056768 00000100:00100000:2.0:1790100604.072601:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141056768 00000100:00100000:2.0:1790100604.072614:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790100604.072624:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+6:20207:x1877056141056384:12345-0@lo:104: 00010000:00010000:2.0:1790100604.072638:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100604.073560:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100604.073570:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+6:20207:x1877056141056384:12345-0@lo:104: Request processed in 946us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100604.073579:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790100604.073605:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100604.073612:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+5:20207:x1877056141056512:12345-0@lo:104: 00010000:00010000:2.0:1790100604.073699:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.074057:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100604.074064:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.074073:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:1.0:1790100604.074076:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.074084:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100604.074091:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100604.074097:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790100604.074131:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.074138:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100604.074158:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.074165:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a63b6400/0xc87a4f2298287f4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287f53 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.074177:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100604.074179:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100604.074191:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100604.074205:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141056896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100604.074252:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100604.074300:0:20207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056384:0@lo:104: 00000100:00100000:1.0:1790100604.076146:0:18335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141056896 00000100:00100000:1.0:1790100604.076159:0:18335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141056896 00010000:00010000:1.0:1790100604.076193:0:18335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 24 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100604.076229:0:18335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100604.076238:0:18335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:687676b7-da9e-40a3-8051-3299bac6cf99+24:3644:x1877056141056896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100604.076252:0:18335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100604.076258:0:18335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 24 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.076269:0:18335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 24 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.076285:0:18335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565d200/0xc87a4f2298287f53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287f4c expref: 24 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.076299:0:18335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100604.076376:0:18335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:687676b7-da9e-40a3-8051-3299bac6cf99+23:3644:x1877056141056896:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100604.076383:0:18335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100604.076443:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b79eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:687676b7-da9e-40a3-8051-3299bac6cf99:3644:1877056141056896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100604.076815:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100604.076823:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+5:20207:x1877056141056512:12345-0@lo:104: Request processed in 3211us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100604.076841:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100604.076870:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100604.076879:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+4:20207:x1877056141056640:12345-0@lo:104: 00010000:00010000:3.0:1790100604.076899:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.076937:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100604.076942:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+4:20207:x1877056141056640:12345-0@lo:104: Request processed in 66us (4578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100604.076948:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100604.076961:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100604.076980:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:20207:x1877056141056768:12345-0@lo:104: 00010000:00010000:3.0:1790100604.076989:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077020:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790100604.077025:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:687676b7-da9e-40a3-8051-3299bac6cf99+3:20207:x1877056141056768:12345-0@lo:104: Request processed in 47us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100604.077030:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790100604.077045:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790100604.077051:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077058:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100604.077062:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077070:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100604.077077:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100604.077082:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100604.077108:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077114:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100604.077130:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077147:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9261a63b7400/0xc87a4f2298287eb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287eb9 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077157:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100604.077160:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077165:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565c400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100604.077168:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077175:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100604.077181:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100604.077186:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100604.077196:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077201:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100604.077206:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077212:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff92619565c400/0xc87a4f2298287e73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e7a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077220:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100604.077228:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077233:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e400 already unused, calling callback (ffffffffc13ccc20) 10000000:00010000:3.0:1790100604.077236:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077243:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100604.077248:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100604.077253:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100604.077263:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077268:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100604.077281:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077288:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff926184b8e400/0xc87a4f2298287e65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc87a4f2298287e6c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077302:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100604.077304:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100604.077306:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100604.077311:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100604.077316:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100604.077326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141057024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100604.077380:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100604.077423:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100604.077429:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141057152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100604.077454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100604.077486:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141057024 00000100:00100000:3.0:1790100604.077491:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141057024 00010000:00010000:3.0:1790100604.077508:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 23 pid: 17174 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.077525:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141057152 00000100:00100000:3.0:1790100604.077527:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141057152 00010000:00010000:3.0:1790100604.077535:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 24 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.077548:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100604.077553:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+24:3641:x1877056141057024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100604.077560:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100604.077564:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 24 pid: 17174 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077572:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 24 pid: 17174 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077585:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100604.077605:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+24:3641:x1877056141057024:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100604.077611:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100604.077621:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100604.077626:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+23:3641:x1877056141057152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100604.077632:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100604.077641:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 23 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077649:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 23 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077657:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100604.077674:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+23:3641:x1877056141057152:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100604.077680:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100604.077702:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141057280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100604.077722:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100604.077761:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141057152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100604.077769:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:687676b7-da9e-40a3-8051-3299bac6cf99:3641:1877056141057024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100604.077785:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141057280 00000100:00100000:3.0:1790100604.077788:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141057280 00010000:00010000:3.0:1790100604.077806:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 23 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.077823:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100604.077828:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+23:3643:x1877056141057280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100604.077847:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100604.077852:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 23 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077861:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 23 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100604.077879:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100604.077916:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:687676b7-da9e-40a3-8051-3299bac6cf99+23:3643:x1877056141057280:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100604.077923:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100604.077948:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:687676b7-da9e-40a3-8051-3299bac6cf99:3643:1877056141057280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100604.079150:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083926800/0xc87a4f2298287eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287eb2 expref: 22 pid: 17174 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100604.079167:0:20207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084835f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056512:0@lo:104: 00010000:00010000:1.0:1790100604.079186:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92619565c200/0xc87a4f2298287e7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287e73 expref: 21 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100604.079195:0:20207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056640:0@lo:104: 00010000:00010000:1.0:1790100604.079203:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926083927000/0xc87a4f2298287e6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc87a4f2298287e65 expref: 20 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100604.079211:0:20207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056768:0@lo:104: 00000100:00100000:1.0:1790100604.079951:0:20207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084836680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056128:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100604.083237:0:20207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1877056141056256:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100604.083289:0:20207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100604.085870:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100604.085969:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100604.086445:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127360640 00000100:00100000:3.0:1790100604.086455:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127360640 00010000:00010000:3.0:1790100604.086491:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 13 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100604.086565:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127360768 00000100:00100000:3.0:1790100604.086569:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127360768 00010000:00010000:3.0:1790100604.086583:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 14 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100604.086616:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1790100604.086626:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926183d45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+14:2422:x1877056127360640:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100604.086641:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100604.086646:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 14 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086656:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 14 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086672:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926191687e00/0xc87a4f22982881a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5a4 expref: 14 pid: 17173 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086693:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100604.086756:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926183d45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:2422:x1877056127360640:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 131us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100604.086780:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1790100604.086825:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1790100604.086831:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:2421:x1877056127360768:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100604.086838:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100604.086843:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 12 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086853:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 12 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086862:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926191687600/0xc87a4f2298288167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e534 expref: 12 pid: 17175 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086873:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086881:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086904:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086912:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086919:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086926:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086939:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7e00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100604.086943:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086951:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086965:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100604.086974:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100604.086993:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:2421:x1877056127360768:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 162us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100604.087000:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:2.0:1790100604.088424:0:20207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100604.088448:0:20207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100604.088455:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9261a63b7e00/0xc87a4f22982881d7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100604.361026:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100604.361218:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100604.361239:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141057536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100604.361307:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100604.361594:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141057536 00000100:00100000:3.0:1790100604.361604:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141057536 00000100:00100000:3.0:1790100604.361663:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100604.361672:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141057536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790100604.361706:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790100604.361752:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141057536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100604.361759:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790100604.361845:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141057536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790100604.362072:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141057408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790100604.362104:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100604.362168:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141057408 00000100:00100000:2.0:1790100604.362173:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141057408 00000100:00100000:2.0:1790100604.362206:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790100604.362213:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141057408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790100604.362232:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790100604.362301:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141057408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100604.362306:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790100604.362380:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141057408:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790100604.682418:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100604.872620:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100604.872645:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141057664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790100604.872713:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100604.872894:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141057664 00000100:00100000:0.0:1790100604.872904:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141057664 00000100:00100000:0.0:1790100604.872971:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100604.872987:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141057664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790100604.873029:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790100604.873079:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141057664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100604.873085:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100604.873134:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141057664:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790100604.873525:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100605.337485:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100605.337563:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127360896 00000100:00100000:0.0:1790100605.337574:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127360896 00000100:00100000:0.0:1790100605.337629:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:0.0:1790100605.337639:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+11:14897:x1877056127360896:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100605.337655:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100605.337673:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926191687a00/0xc87a4f22982881de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e5dc expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100605.337702:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926191687a00/0xc87a4f22982881de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5dc expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100605.337713:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926191687a00/0xc87a4f22982881de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5dc expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100605.337722:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191687a00, rc 0) 00000100:00100000:0.0:1790100605.337777:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:14897:x1877056127360896:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 139us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100605.337785:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:1.0:1790100605.349264:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100605.349334:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127361024 00000100:00100000:3.0:1790100605.349367:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127361024 00000100:00100000:3.0:1790100605.349435:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:3.0:1790100605.349446:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:14897:x1877056127361024:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100605.349587:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:14897:x1877056127361024:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 143us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.349595:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:3.0:1790100605.354026:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100605.354180:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127361152 00000100:00100000:1.0:1790100605.354191:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127361152 00000100:00100000:1.0:1790100605.354238:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:1.0:1790100605.354247:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:14897:x1877056127361152:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100605.354402:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:14897:x1877056127361152:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 155us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100605.354410:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:3.0:1790100605.361312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100605.361636:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127361280 00000100:00100000:1.0:1790100605.361646:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127361280 00000100:00100000:1.0:1790100605.361697:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:1.0:1790100605.361705:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+12:14897:x1877056127361280:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100605.361722:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100605.361738:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926184b8e200/0xc87a4f22982881e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e5e3 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.361763:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926184b8e200/0xc87a4f22982881e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5e3 expref: 13 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.361773:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926184b8e200/0xc87a4f22982881e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5e3 expref: 13 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.361782:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e200, rc 0) 00000100:00100000:1.0:1790100605.361843:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:14897:x1877056127361280:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 139us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100605.361850:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:1.0:1790100605.369592:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100605.369685:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127361408 00000100:00100000:3.0:1790100605.369695:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127361408 00000100:00100000:3.0:1790100605.369748:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:3.0:1790100605.369757:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:14897:x1877056127361408:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100605.369915:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:14897:x1877056127361408:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 159us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.369923:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:3.0:1790100605.376309:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100605.376351:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127361536 00000100:00100000:3.0:1790100605.376360:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127361536 00000100:00100000:3.0:1790100605.376397:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:3.0:1790100605.376406:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:14897:x1877056127361536:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100605.377603:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:14897:x1877056127361536:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 1188us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.378779:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:2.0:1790100605.384996:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100605.385035:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141057792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100605.385100:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.385145:0:19974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141057792 00000100:00100000:2.0:1790100605.385152:0:19974:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141057792 00000100:00100000:2.0:1790100605.385202:0:19974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790100605.385211:0:19974:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141057792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100605.385238:0:19974:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790100605.385278:0:19974:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141057792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100605.385285:0:19974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1790100605.385304:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100605.385331:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141057792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100605.387174:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100605.387190:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a636a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141057920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100605.387240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100605.387287:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141057920 00000100:00100000:0.0:1790100605.387293:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141057920 00000100:00100000:0.0:1790100605.387337:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100605.387360:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141057920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790100605.387377:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790100605.387416:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141057920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100605.387422:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100605.388182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a636a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141057920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790100605.388202:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141058048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100605.388229:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100605.388255:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141058048 00000100:00100000:0.0:1790100605.388258:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141058048 00000100:00100000:0.0:1790100605.388568:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100605.388576:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141058048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100605.388591:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790100605.388627:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877056141058048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100605.388633:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100605.388661:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261a6368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1877056141058048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790100605.388674:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100605.388678:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100605.389117:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141058176:0@lo:400:kworker.0 00000100:00100000:0.0:1790100605.389151:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100605.389192:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141058176 00000100:00100000:0.0:1790100605.389197:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141058176 00000100:00100000:0.0:1790100605.389236:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790100605.389243:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+20:3642:x1877056141058176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100605.389279:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+20:3642:x1877056141058176:12345-0@lo:400:kworker.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100605.389285:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790100605.389316:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141058176:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.389332:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141058304:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.389378:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100605.389454:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100605.389467:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141058432:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.389492:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100605.389518:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141058432 00000100:00100000:3.0:1790100605.389522:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141058432 00000100:00100000:3.0:1790100605.389548:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790100605.389554:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141058432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.389587:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1877056141058432:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.389592:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790100605.389683:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1877056141058432:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.389792:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141058560:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.389888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100605.389951:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100605.389958:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141058688:0@lo:400:kworker.0 00000100:00100000:0.0:1790100605.389976:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141058304 00000100:00100000:3.0:1790100605.389981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100605.389981:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141058304 00000100:00100000:0.0:1790100605.392984:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141058560 00000100:00100000:0.0:1790100605.392996:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141058560 00000100:00100000:3.0:1790100605.393556:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790100605.393568:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141058304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.393712:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141058304:12345-0@lo:400:kworker.0 Request processed in 146us (4332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100605.393716:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100605.393721:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790100605.393724:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141058560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100605.393757:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877056141058560:12345-0@lo:400:kworker.0 Request processed in 34us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.393761:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141059072:0@lo:400:kworker.0 00000100:00100000:0.0:1790100605.393763:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790100605.393781:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056141059200:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.393797:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100605.393914:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1877056141058560:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.393946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100605.393971:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141058688 00000100:00100000:3.0:1790100605.393981:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141058688 00000100:00100000:3.0:1790100605.394083:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141059072 00000100:00100000:3.0:1790100605.394087:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141059072 00000100:00100000:3.0:1790100605.394109:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141059200 00000100:00100000:3.0:1790100605.394111:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141059200 00000100:00100000:3.0:1790100605.394123:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100605.394128:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141058688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.394164:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877056141058688:12345-0@lo:400:kworker.0 Request processed in 35us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.394170:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100605.394181:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790100605.394188:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056141059072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.394213:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877056141059072:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.394218:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790100605.394228:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790100605.394233:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056141059200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.394258:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877056141059200:12345-0@lo:400:kworker.0 Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.394263:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1790100605.394289:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260831b8000 x1877056141059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100605.394300:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1877056141059200:0@lo:400:kworker.0 00000100:00080000:3.0:1790100605.394314:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790100605.394318:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100605.394332:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1877056141059072:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.394455:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877056141058688:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.394476:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056141058816:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.394501:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100605.394540:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056141058944:0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.394563:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141058304:0@lo:400:kworker.0 00000100:00100000:0.0:1790100605.394567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.395333:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141058816 00000100:00100000:2.0:1790100605.395373:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141058816 00000100:00100000:3.0:1790100605.395712:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141058944 00000100:00100000:3.0:1790100605.395717:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141058944 00000100:00100000:3.0:1790100605.395749:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100605.395757:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056141058816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.395811:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1877056141058816:12345-0@lo:400:kworker.0 Request processed in 55us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.395829:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100605.395846:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790100605.395852:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056141058944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100605.395893:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1877056141058944:12345-0@lo:400:kworker.0 Request processed in 29us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.395899:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1790100605.395916:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790100605.395919:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100605.395942:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1877056141058816:0@lo:400:kworker.0 00010000:00080000:0.0:1790100605.396074:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9260831bb480 x1877056141058944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100605.396085:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1877056141058944:0@lo:400:kworker.0 00010000:00010000:3.0:1790100605.706833:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790100605.832705:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790100605.832712:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926083d0d800 from 13 10000000:01000000:2.0:1790100605.832717:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790100605.832865:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f22982881ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.832888:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f22982881ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.832900:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f22982881ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100605.832924:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.832984:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.833027:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100605.833068:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141059328 00000100:00100000:3.0:1790100605.833077:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141059328 00000100:00100000:3.0:1790100605.833131:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790100605.833140:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+20:17177:x1877056141059328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100605.833152:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100605.833171:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7400/0xc87a4f22982881f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982881ec expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.833195:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7400/0xc87a4f22982881f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982881ec expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.833205:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7400/0xc87a4f22982881f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982881ec expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.833213:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7400, rc 0) 00000100:00100000:3.0:1790100605.833254:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141059328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.833260:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790100605.838637:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100605.838666:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f22982881ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982881f3 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.838678:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f22982881ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f22982881f3 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100605.838760:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100605.839360:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100605.839862:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141059456 00000100:00100000:0.0:1790100605.839871:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141059456 00000100:00100000:0.0:1790100605.840042:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790100605.840052:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141059456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100605.840192:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141059456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100605.840199:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790100605.841664:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083c65b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100605.841698:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.841798:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.842172:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.842246:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100605.842289:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141059584 00000100:00100000:3.0:1790100605.842296:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141059584 00000100:00100000:0.0:1790100605.842430:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790100605.842441:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141059584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100605.842556:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141059584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100605.842563:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790100605.842615:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790100605.846683:0:20292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790100605.847210:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790100605.847232:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100605.847242:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f22982881ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982881f3 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.847255:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e46400/0xc87a4f22982881ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f22982881f3 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100605.847266:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100605.847269:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b230b800 from 13 10000000:01000000:1.0:1790100605.847282:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100605.847316:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8f800/0xc87a4f22982881fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.847325:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8f800/0xc87a4f22982881fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.847335:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8f800/0xc87a4f22982881fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100605.847547:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100605.847609:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100605.847702:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b6800c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100605.847747:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141059712 00000100:00100000:3.0:1790100605.847754:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141059712 00000100:00100000:3.0:1790100605.847797:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790100605.847805:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+21:17177:x1877056141059712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100605.848167:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100605.848189:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b7800/0xc87a4f2298288201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f22982881fa expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.848212:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b7800/0xc87a4f2298288201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f22982881fa expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.848221:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b7800/0xc87a4f2298288201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f22982881fa expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.848229:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7800, rc 0) 00000100:00100000:3.0:1790100605.848310:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+22:17177:x1877056141059712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 506us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.848316:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790100605.848553:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100605.848568:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8f800/0xc87a4f22982881fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298288201 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.848577:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8f800/0xc87a4f22982881fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f2298288201 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100605.848647:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100605.848675:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100605.848747:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b6800c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100605.849263:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141059840 00000100:00100000:2.0:1790100605.849268:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141059840 00000100:00100000:2.0:1790100605.849368:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790100605.849386:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+22:17177:x1877056141059840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.849510:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+22:17177:x1877056141059840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100605.849517:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790100605.849597:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100605.849627:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100605.849664:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100605.850275:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b6800c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100605.850316:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141059968 00000100:00100000:3.0:1790100605.850322:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141059968 00000100:00100000:3.0:1790100605.850370:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790100605.850486:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+22:17177:x1877056141059968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100605.850577:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+22:17177:x1877056141059968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.850584:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790100605.850675:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141059968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790100605.859484:0:20293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790100605.861259:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790100605.861291:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100605.861301:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8f800/0xc87a4f22982881fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298288201 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.861314:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8f800/0xc87a4f22982881fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f2298288201 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100605.861325:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100605.861327:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9261b5ae0000 from 13 10000000:01000000:1.0:1790100605.861330:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100605.861395:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8f000/0xc87a4f2298288208 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.861404:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926184b8f000/0xc87a4f2298288208 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100605.861414:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926184b8f000/0xc87a4f2298288208 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100605.861439:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100605.861499:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100605.861538:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b6800c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100605.861713:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141060096 00000100:00100000:3.0:1790100605.861720:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141060096 00000100:00100000:3.0:1790100605.861773:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790100605.861783:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+22:17177:x1877056141060096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100605.861795:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100605.861807:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9261a63b6e00/0xc87a4f229828820f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298288208 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.861830:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9261a63b6e00/0xc87a4f229828820f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298288208 expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.861851:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9261a63b6e00/0xc87a4f229828820f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298288208 expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.861858:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6e00, rc 0) 00000100:00100000:3.0:1790100605.861928:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141060096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.861935:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790100605.862237:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100605.862253:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926184b8f000/0xc87a4f2298288208 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828820f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.862263:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926184b8f000/0xc87a4f2298288208 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f229828820f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100605.862321:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.862413:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.862432:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb840 going to sleep for 11 seconds 00000100:00100000:3.0:1790100605.862542:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141060224 00000100:00100000:3.0:1790100605.862547:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141060224 00000100:00100000:3.0:1790100605.862581:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790100605.862589:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141060224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100605.862686:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141060224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.862692:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790100605.862756:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.862781:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.862820:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.862839:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb840 going to sleep for 11 seconds 00000100:00100000:3.0:1790100605.862882:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141060352 00000100:00100000:3.0:1790100605.862887:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141060352 00000100:00100000:3.0:1790100605.863068:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790100605.863076:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083d5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141060352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100605.863156:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083d5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141060352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100605.863162:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790100605.863989:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790100605.864835:0:20295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790100605.864899:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790100605.864914:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790100605.864922:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926184b8f000/0xc87a4f2298288208 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828820f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.864934:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926184b8f000/0xc87a4f2298288208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828820f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100605.864943:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790100605.864946:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926184c6f000 from 13 10000000:01000000:2.0:1790100605.864954:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790100605.864991:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47200/0xc87a4f2298288216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.864999:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff926083e47200/0xc87a4f2298288216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.865008:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff926083e47200/0xc87a4f2298288216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100605.865025:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.865292:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.865327:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb300 going to sleep for 11 seconds 00000100:00100000:2.0:1790100605.865364:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141060480 00000100:00100000:2.0:1790100605.865370:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141060480 00000100:00100000:2.0:1790100605.865479:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790100605.865486:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+23:17177:x1877056141060480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100605.865499:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100605.865511:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926083e47000/0xc87a4f229828821d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc87a4f2298288216 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.865531:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926083e47000/0xc87a4f229828821d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc87a4f2298288216 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.865540:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926083e47000/0xc87a4f229828821d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc87a4f2298288216 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.865548:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47000, rc 0) 00000100:00100000:2.0:1790100605.865580:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:17177:x1877056141060480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100605.865596:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790100605.865636:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100605.865647:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff926083e47200/0xc87a4f2298288216 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828821d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100605.865654:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff926083e47200/0xc87a4f2298288216 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc87a4f229828821d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100605.865699:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.865725:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.865738:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb300 going to sleep for 11 seconds 00000100:00100000:2.0:1790100605.865749:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141060608 00000100:00100000:2.0:1790100605.865752:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141060608 00000100:00100000:2.0:1790100605.865768:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790100605.865773:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:17177:x1877056141060608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.865862:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:17177:x1877056141060608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100605.865870:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790100605.865909:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.865932:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.865981:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100605.865999:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb300 going to sleep for 11 seconds 00000100:00100000:2.0:1790100605.866009:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141060736 00000100:00100000:2.0:1790100605.866012:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141060736 00000100:00100000:2.0:1790100605.866027:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790100605.866041:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:17177:x1877056141060736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100605.866310:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:687676b7-da9e-40a3-8051-3299bac6cf99+24:17177:x1877056141060736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100605.866317:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790100605.866480:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:687676b7-da9e-40a3-8051-3299bac6cf99:17177:1877056141060736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100605.868202:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790100605.868490:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790100605.868512:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100605.868521:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff926083e47200/0xc87a4f2298288216 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828821d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100605.868545:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff926083e47200/0xc87a4f2298288216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc87a4f229828821d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.728562:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100607.200897:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.200987:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127361664 00000100:00100000:3.0:1790100607.200997:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127361664 00000100:00100000:3.0:1790100607.201066:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1790100607.201076:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+6:15565:x1877056127361664:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100607.201094:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100607.201114:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e5ea expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201171:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790100607.201185:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100607.201190:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201205:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201219:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201225:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201232:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201328:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298288239 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201380:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298288239 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201388:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298288239 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100607.201417:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790100607.201421:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100607.201457:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298288239 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201468:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201475:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201482:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201488:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100607.201492:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201498:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201509:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b100) 00010000:00010000:3.0:1790100607.201518:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100607.201524:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201531:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828822b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201544:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201550:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201557:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201562:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100607.201564:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201570:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201577:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9261900b4b00) 00010000:00010000:3.0:1790100607.201579:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100607.201582:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201587:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201617:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5ea expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201639:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7000/0xc87a4f2298288239 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5ea expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.201647:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9261900b4c00) 00010000:00010000:3.0:1790100607.201649:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100607.201652:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7000, rc 0) 00000100:00100000:3.0:1790100607.201710:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+7:15565:x1877056127361664:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 636us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.201718:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1790100607.208623:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.208823:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127361792 00000100:00100000:2.0:1790100607.208833:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127361792 00000100:00100000:2.0:1790100607.208899:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1790100607.208909:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:04100da5-99d0-41db-b436-f542c1b00474+7:15565:x1877056127361792:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790100607.209005:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:04100da5-99d0-41db-b436-f542c1b00474+7:15565:x1877056127361792:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 97us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.209013:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1790100607.222441:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100607.222528:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127362048 00000100:00100000:0.0:1790100607.222538:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127362048 00000100:00100000:0.0:1790100607.222588:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1790100607.222597:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+7:15565:x1877056127362048:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100607.222614:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100607.222632:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686a00/0xc87a4f2298288240 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e5f1 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222698:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222712:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222723:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222814:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222822:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222829:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222959:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191687800/0xc87a4f2298288255 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222969:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191687800/0xc87a4f2298288255 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.222976:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191687800/0xc87a4f2298288255 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100607.222986:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790100607.223111:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223119:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223126:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223132:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100607.223136:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223152:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223164:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9261900b4c00) 00010000:00010000:0.0:1790100607.223166:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.223171:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223177:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f2298288247 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223190:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223196:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223202:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223207:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100607.223210:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223216:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223222:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9261c1af1500) 00010000:00010000:0.0:1790100607.223224:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.223227:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.223240:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828824e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.224256:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686a00/0xc87a4f2298288240 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5f1 expref: 10 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.224277:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926191687800/0xc87a4f2298288255 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5f1 expref: 9 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.224285:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9261c1af1300) 00010000:00010000:0.0:1790100607.224288:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.224291:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191687800, rc 0) 00000100:00100000:0.0:1790100607.224434:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+9:15565:x1877056127362048:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1836us (2001us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790100607.224442:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1790100607.235555:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.235688:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127362176 00000100:00100000:3.0:1790100607.235698:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127362176 00000100:00100000:3.0:1790100607.235752:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1790100607.235761:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+9:15565:x1877056127362176:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790100607.235971:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+9:15565:x1877056127362176:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 210us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.235979:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000040:00080000:2.0:1790100607.241075:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790100607.243020:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100607.243114:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127362304 00000100:00100000:0.0:1790100607.243124:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127362304 00000100:00100000:0.0:1790100607.243292:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1790100607.243303:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+5:15565:x1877056127362304:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1790100607.247096:0:17180:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3733us 00000100:00080000:3.0:1790100607.247324:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790100607.256941:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+5:15565:x1877056127362304:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 13631us (13920us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100607.256962:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1790100607.275326:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.275467:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127362432 00000100:00100000:3.0:1790100607.275476:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127362432 00000100:00100000:3.0:1790100607.275527:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1790100607.275536:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+9:15571:x1877056127362432:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100607.275555:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100607.275575:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e5f8 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275652:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275666:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275676:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275691:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275697:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275702:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275734:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275740:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275746:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275751:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100607.275755:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275771:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275783:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b100) 00010000:00010000:3.0:1790100607.275785:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100607.275790:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.275796:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f229828826a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276602:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276613:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276619:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276623:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100607.276627:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276633:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276643:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9261900b4b00) 00010000:00010000:3.0:1790100607.276647:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100607.276650:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276683:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288271 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276726:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288263 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5f8 expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276735:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b100) 00010000:00010000:3.0:1790100607.276738:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100607.276741:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5f8 expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.276748:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:3.0:1790100607.276814:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+9:15571:x1877056127362432:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1279us (1496us total) trans 0 rc 301/301 00000100:00100000:3.0:1790100607.276821:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1790100607.283003:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.283409:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127362560 00000100:00100000:3.0:1790100607.283420:0:17189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127362560 00000100:00100000:3.0:1790100607.283471:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1790100607.283481:0:17189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:04100da5-99d0-41db-b436-f542c1b00474+9:15571:x1877056127362560:12345-192.168.203.13@tcp:700:lfs.0 00000100:00100000:2.0:1790100607.283622:0:17189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:04100da5-99d0-41db-b436-f542c1b00474+9:15571:x1877056127362560:12345-192.168.203.13@tcp:700:lfs.0 Request processed in 141us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.283634:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1790100607.286676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.286754:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127362816 00000100:00100000:3.0:1790100607.286764:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127362816 00000100:00100000:3.0:1790100607.286823:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1790100607.286832:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+9:15571:x1877056127362816:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:3.0:1790100607.286899:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100607.286933:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288191 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e565 expref: 9 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.286967:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b100) 00010000:00010000:3.0:1790100607.286972:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100607.287028:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.287042:0:17180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 5 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.287051:0:17180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.287081:0:17180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 5 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.287094:0:17180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 5 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100607.287109:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141060864:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100607.287222:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100607.289531:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.289674:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084837100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141060864:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790100607.289700:0:17180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100607.289766:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127362944 00000100:00100000:2.0:1790100607.289773:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127362944 00010000:00010000:2.0:1790100607.289982:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 6 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100607.290018:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1790100607.290037:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:2421:x1877056127362944:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100607.290050:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100607.290057:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 6 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.290069:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 6 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.290087:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982881d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5d5 expref: 6 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.290102:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b100) 00010000:00010000:2.0:1790100607.290107:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.290116:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.290123:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.290193:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100607.290235:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2421:x1877056127362944:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 199us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.290243:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00080000:3.0:1790100607.290448:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790100607.292695:0:17180:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.292713:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.294308:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.294328:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.294503:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298294:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298317:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298329:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100607.298750:0:17180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af814e28 reply state 000000005ad06798 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298765:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298785:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:1.0:1790100607.298788:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100607.298792:0:17180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790100607.298807:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790100607.298816:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298823:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298831:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298842:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b6a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100607.298847:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298854:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298864:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261b209b100) 00010000:00010000:1.0:1790100607.298874:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100607.298878:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298884:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f2298288278 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100607.298905:0:17180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af814e28 reply state 000000005ad06798 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298925:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.298932:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9261c1af0a00) 00010000:00010000:1.0:1790100607.298934:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790100607.298936:0:17180:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790100607.299058:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+10:15571:x1877056127362816:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 12224us (12388us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790100607.299067:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000040:00080000:2.0:1790100607.307837:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790100607.401443:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.401542:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127363072 00000100:00100000:2.0:1790100607.401552:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127363072 00000100:00100000:2.0:1790100607.401613:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1790100607.401635:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+10:15580:x1877056127363072:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:2.0:1790100607.401660:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100607.401680:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828828d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e5ff expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.401736:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298288294 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.401749:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298288294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.401759:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298288294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100607.401809:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790100607.401813:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100607.401847:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298288294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.401877:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828828d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5ff expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.401895:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46200/0xc87a4f2298288294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e5ff expref: 11 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.401910:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6366a00) 00010000:00010000:2.0:1790100607.401914:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100607.401917:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46200, rc 0) 00000100:00100000:2.0:1790100607.401968:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+11:15580:x1877056127363072:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 335us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.401983:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1790100607.431517:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.431670:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127363200 00000100:00100000:1.0:1790100607.431680:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127363200 00000100:00100000:1.0:1790100607.431739:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1790100607.431749:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:15581:x1877056127363200:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790100607.431770:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100607.431790:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828829b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e606 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.431859:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f22982882a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.431884:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f22982882a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.431896:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f22982882a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100607.431946:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790100607.431949:0:17180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790100607.431982:0:17180:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f22982882a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.432006:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828829b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e606 expref: 7 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.432023:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e800/0xc87a4f22982882a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e606 expref: 6 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.432032:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6366a00) 00010000:00010000:1.0:1790100607.432035:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100607.432039:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926184b8e800, rc 0) 00000100:00100000:1.0:1790100607.432094:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15581:x1877056127363200:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 346us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100607.432101:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1790100607.435726:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100607.435911:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127363328 00000100:00100000:0.0:1790100607.435921:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127363328 00000100:00100000:0.0:1790100607.435993:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1790100607.436002:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+6:15581:x1877056127363328:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100607.436021:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100607.436041:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686a00/0xc87a4f22982882a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e60d expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436098:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436113:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436124:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436135:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436142:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436149:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436221:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982882be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436230:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982882be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436237:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982882be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100607.436290:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790100607.436295:0:17182:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100607.436314:0:17182:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982882be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436326:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436333:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436397:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436404:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100607.436408:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436416:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436428:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6366a00) 00010000:00010000:0.0:1790100607.436432:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.436436:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436442:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436456:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436473:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436480:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436485:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100607.436488:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436495:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436503:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9261c1af0a00) 00010000:00010000:0.0:1790100607.436506:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.436508:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436514:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436539:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686a00/0xc87a4f22982882a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e60d expref: 8 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436552:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982882be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e60d expref: 7 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.436560:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:0.0:1790100607.436562:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100607.436570:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191686e00, rc 0) 00000100:00100000:0.0:1790100607.436616:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+7:15581:x1877056127363328:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 615us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100607.436623:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1790100607.439622:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.439703:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127363456 00000100:00100000:2.0:1790100607.439712:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127363456 00000100:00100000:2.0:1790100607.439772:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1790100607.439781:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:15581:x1877056127363456:12345-192.168.203.13@tcp:900:lfs.0 00000100:00100000:2.0:1790100607.439880:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:15581:x1877056127363456:12345-192.168.203.13@tcp:900:lfs.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.439887:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:3.0:1790100607.440084:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790100607.443457:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.443546:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127363712 00000100:00100000:3.0:1790100607.443556:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127363712 00000100:00100000:3.0:1790100607.443614:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1790100607.443625:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+7:15581:x1877056127363712:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100607.443656:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100607.443675:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982882c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e614 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100607.443792:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790100607.444068:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982882c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e614 expref: 9 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.444083:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6366a00) 00010000:00010000:3.0:1790100607.444086:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100607.444093:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982882c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e614 expref: 9 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.444108:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7e00, rc 0) 00000100:00100000:3.0:1790100607.444170:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+8:15581:x1877056127363712:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 547us (721us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790100607.444176:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1790100607.446738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.446831:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127363968 00000100:00100000:1.0:1790100607.446840:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127363968 00000100:00100000:1.0:1790100607.446912:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1790100607.446922:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+8:15581:x1877056127363968:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:1.0:1790100607.446969:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100607.446991:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686e00/0xc87a4f22982882be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e60d expref: 8 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.447008:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:1.0:1790100607.447012:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100607.447031:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.447058:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.447068:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100607.447246:0:17180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079f9f774 reply state 000000009c8c1e24 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.447259:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.447266:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:1.0:1790100607.447268:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790100607.447271:0:17180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790100607.447277:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790100607.447371:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+9:15581:x1877056127363968:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 450us (642us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790100607.447377:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1790100607.450223:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.450297:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127364224 00000100:00100000:3.0:1790100607.450306:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127364224 00000100:00100000:3.0:1790100607.450387:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1790100607.450397:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+9:15581:x1877056127364224:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790100607.450593:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+10:15581:x1877056127364224:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 197us (380us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790100607.450601:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1790100607.453895:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100607.454122:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127364480 00000100:00100000:0.0:1790100607.454132:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127364480 00000100:00100000:0.0:1790100607.454181:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:0.0:1790100607.454190:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+10:15581:x1877056127364480:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790100607.454211:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100607.454228:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e61b expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454290:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454303:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454313:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454323:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454330:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454355:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100607.454566:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790100607.454628:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454637:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454643:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454649:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100607.454653:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454660:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454671:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6366a00) 00010000:00010000:0.0:1790100607.454674:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.454678:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454685:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f22982882e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454696:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454702:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454717:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454722:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100607.454725:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454731:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454738:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9261c1af0a00) 00010000:00010000:0.0:1790100607.454740:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.454743:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454748:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f22982882e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454779:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e61b expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454788:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6366a00) 00010000:00010000:0.0:1790100607.454790:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100607.454794:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686000/0xc87a4f22982882da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e61b expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.454813:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191686000, rc 0) 00000100:00100000:0.0:1790100607.454877:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ceeef86-d61d-43f2-a898-ec1ecb26226c+11:15581:x1877056127364480:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 687us (990us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1790100607.454893:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:0.0:1790100607.457727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.457813:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127364608 00000100:00100000:3.0:1790100607.457822:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127364608 00000100:00100000:3.0:1790100607.457888:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1790100607.457923:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+11:15581:x1877056127364608:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790100607.457945:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100607.457963:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982882f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e622 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.458050:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.458063:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.458075:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100607.458099:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790100607.458103:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100607.458121:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.458145:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982882f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.458163:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.458171:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:3.0:1790100607.458174:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100607.458177:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6400, rc 0) 00000100:00100000:3.0:1790100607.458236:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+12:15581:x1877056127364608:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 315us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.458252:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:2.0:1790100607.461796:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.461935:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127364736 00000100:00100000:3.0:1790100607.461946:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127364736 00000100:00100000:3.0:1790100607.462049:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1790100607.462058:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+12:15581:x1877056127364736:12345-192.168.203.13@tcp:37:lfs.0 00000100:00100000:3.0:1790100607.466800:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+12:15581:x1877056127364736:12345-192.168.203.13@tcp:37:lfs.0 Request processed in 4733us (5004us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.467458:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1790100607.469605:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.469693:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127364992 00000100:00100000:1.0:1790100607.469703:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127364992 00000100:00100000:1.0:1790100607.469757:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1790100607.469767:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a6489050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+12:15581:x1877056127364992:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100607.469992:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a6489050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+13:15581:x1877056127364992:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 226us (394us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790100607.469999:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1790100607.522170:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100607.522256:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127365120 00000100:00100000:0.0:1790100607.522267:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127365120 00000100:00100000:0.0:1790100607.522325:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1790100607.522334:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+11:15587:x1877056127365120:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790100607.522381:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100607.522401:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f2298288304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e629 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522460:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522474:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522485:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522495:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522503:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522510:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522583:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686600/0xc87a4f2298288319 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522605:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686600/0xc87a4f2298288319 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522613:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686600/0xc87a4f2298288319 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100607.522646:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790100607.522650:0:17182:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790100607.522685:0:17182:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926191686600/0xc87a4f2298288319 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522697:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522703:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522709:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522714:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100607.522718:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522725:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522736:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6366a00) 00010000:00010000:0.0:1790100607.522739:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.522744:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522759:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f229828830b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522773:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522779:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522784:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522789:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100607.522792:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522798:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522882:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9261c1af0a00) 00010000:00010000:0.0:1790100607.522884:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100607.522888:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522894:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686200/0xc87a4f2298288312 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.522980:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191687200/0xc87a4f2298288304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e629 expref: 13 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.523007:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686600/0xc87a4f2298288319 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e629 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.523014:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:0.0:1790100607.523017:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790100607.523020:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926191686600, rc 0) 00000100:00100000:0.0:1790100607.523084:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+12:15587:x1877056127365120:12345-192.168.203.13@tcp:101:bash.0 Request processed in 751us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100607.523092:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1790100607.526095:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.526456:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127365248 00000100:00100000:1.0:1790100607.526466:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127365248 00000100:00100000:1.0:1790100607.526532:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790100607.526541:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:04100da5-99d0-41db-b436-f542c1b00474+5:15587:x1877056127365248:12345-192.168.203.13@tcp:900:bash.0 00000100:00100000:1.0:1790100607.526622:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:04100da5-99d0-41db-b436-f542c1b00474+5:15587:x1877056127365248:12345-192.168.203.13@tcp:900:bash.0 Request processed in 82us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100607.526629:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790100607.531050:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.531315:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127365504 00000100:00100000:2.0:1790100607.531324:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127365504 00000100:00100000:2.0:1790100607.531399:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1790100607.531414:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+12:15587:x1877056127365504:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100607.531432:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100607.531450:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298288320 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e630 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.531550:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.531566:0:17180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.531588:0:17180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.531620:0:17180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.531633:0:17180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 12 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100607.531647:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141060992:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100607.531727:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ddb240 going to sleep for 11 seconds 00000100:00100000:3.0:1790100607.534476:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100607.534571:0:18335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127365632 00000100:00100000:0.0:1790100607.534580:0:18335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127365632 00010000:00010000:0.0:1790100607.534617:0:18335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 13 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100607.534658:0:18335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790100607.534667:0:18335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ceeef86-d61d-43f2-a898-ec1ecb26226c+13:2422:x1877056127365632:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100607.534680:0:18335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100607.534686:0:18335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 13 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.534699:0:18335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 13 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.534720:0:18335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:0.0:1790100607.534725:0:18335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.534746:0:18335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.534754:0:18335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100607.534773:0:18335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100607.534841:0:18335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ceeef86-d61d-43f2-a898-ec1ecb26226c+13:2422:x1877056127365632:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 175us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100607.534849:0:18335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00010000:00010000:2.0:1790100607.535391:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f22982882fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e622 expref: 12 pid: 17181 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100607.535418:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141060992:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100607.535440:0:17180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.535449:0:17180:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.535455:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.535477:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.535487:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.535504:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.535954:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.535964:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.535972:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100607.535982:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790100607.536005:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536012:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536020:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536025:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100607.536030:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536038:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536048:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:2.0:1790100607.536051:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100607.536063:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536070:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f2298288327 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100607.536081:0:17180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000559e441c reply state 00000000d665fcfd transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536093:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536099:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9261a6366900) 00010000:00010000:2.0:1790100607.536102:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100607.536104:0:17180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790100607.536135:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298288320 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 15 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536149:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 14 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.536157:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100607.536160:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790100607.536162:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46e00, rc 0) 00000100:00100000:2.0:1790100607.536217:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+15:15587:x1877056127365504:12345-192.168.203.13@tcp:101:bash.0 Request processed in 4811us (5175us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1790100607.536225:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1790100607.550757:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.550898:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127365760 00000100:00100000:2.0:1790100607.550916:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127365760 00000100:00100000:2.0:1790100607.550969:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1790100607.550978:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+15:15587:x1877056127365760:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790100607.551012:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100607.551030:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298288343 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e637 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.551089:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.551102:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.551112:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100607.551153:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790100607.551156:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100607.551172:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.551182:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.551204:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298288343 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.551220:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 16 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.551229:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100607.551232:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100607.551236:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47a00, rc 0) 00000100:00100000:2.0:1790100607.551296:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+16:15587:x1877056127365760:12345-192.168.203.13@tcp:101:bash.0 Request processed in 319us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.551303:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1790100607.554118:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.554268:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127366016 00000100:00100000:1.0:1790100607.554276:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127366016 00000100:00100000:1.0:1790100607.554325:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1790100607.554333:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+16:15587:x1877056127366016:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1790100607.554613:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+17:15587:x1877056127366016:12345-192.168.203.13@tcp:35:bash.0 Request processed in 279us (502us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790100607.554620:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1790100607.629226:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.629376:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127366272 00000100:00100000:2.0:1790100607.629386:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127366272 00000100:00100000:2.0:1790100607.629453:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1790100607.629462:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+17:15597:x1877056127366272:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100607.629485:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100607.629503:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298288351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e63e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100607.629595:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790100607.629685:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298288351 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e63e expref: 19 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.629699:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9261a6366a00) 00010000:00010000:2.0:1790100607.629703:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100607.629708:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f2298288351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e63e expref: 19 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.629722:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e46800, rc 0) 00000100:00100000:2.0:1790100607.629781:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+18:15597:x1877056127366272:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 320us (563us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1790100607.629789:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1790100607.633680:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.633766:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127366528 00000100:00100000:1.0:1790100607.633777:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127366528 00000100:00100000:1.0:1790100607.633839:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1790100607.633849:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+18:15597:x1877056127366528:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100607.634110:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+19:15597:x1877056127366528:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 262us (437us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790100607.634119:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1790100607.679860:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.679969:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127366784 00000100:00100000:2.0:1790100607.679978:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127366784 00000100:00100000:2.0:1790100607.680045:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1790100607.680054:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+19:15600:x1877056127366784:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790100607.680077:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100607.680094:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828835f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e645 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.680198:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288366 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.680213:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.680223:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100607.680234:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790100607.680329:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828835f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e645 expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.680391:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288366 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e645 expref: 21 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.680401:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100607.680405:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100607.680418:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47400, rc 0) 00000100:00100000:2.0:1790100607.680474:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+21:15600:x1877056127366784:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 421us (624us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790100607.680481:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1790100607.684325:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.684401:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.684479:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127367040 00000100:00100000:1.0:1790100607.684489:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127367040 00000100:00100000:1.0:1790100607.684551:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1790100607.684561:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04100da5-99d0-41db-b436-f542c1b00474+21:2421:x1877056127367040:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100607.684574:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100607.684601:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288366 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e645 expref: 21 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100607.684619:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:1.0:1790100607.684623:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100607.684677:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04100da5-99d0-41db-b436-f542c1b00474+20:2421:x1877056127367040:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100607.684684:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1790100607.685092:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127366912 00000100:00100000:3.0:1790100607.685098:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127366912 00000100:00100000:3.0:1790100607.685137:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1790100607.685144:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+20:15600:x1877056127366912:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1790100607.685194:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685208:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685218:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685256:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685263:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685276:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685281:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261a63b7e00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100607.685285:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685292:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685302:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:3.0:1790100607.685305:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100607.685308:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100607.685315:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288374 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100607.685390:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+20:15600:x1877056127366912:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 246us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.685397:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1790100607.687319:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.687514:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127367296 00000100:00100000:1.0:1790100607.687522:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127367296 00000100:00100000:1.0:1790100607.687571:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790100607.687580:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+20:15600:x1877056127367296:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790100607.687776:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+21:15600:x1877056127367296:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 196us (463us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1790100607.687783:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00010000:00010000:3.0:1790100607.754279:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100607.831001:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.831042:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.831213:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127367424 00000100:00100000:2.0:1790100607.831223:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127367424 00000100:00100000:2.0:1790100607.831275:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:2.0:1790100607.831284:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:2420:x1877056127367424:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790100607.831382:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e7fc04d-7cd4-42ff-b4a7-861b0bfceae3+13:2420:x1877056127367424:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 99us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.831389:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:1.0:1790100607.831723:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127367552 00000100:00100000:1.0:1790100607.831728:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127367552 00000100:00100000:1.0:1790100607.831772:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1790100607.831780:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2420:x1877056127367552:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100607.831815:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2420:x1877056127367552:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100607.831821:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:2.0:1790100607.834809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.835300:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127367808 00000100:00100000:1.0:1790100607.835309:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127367808 00000100:00100000:1.0:1790100607.835392:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1790100607.835402:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04100da5-99d0-41db-b436-f542c1b00474+5:2419:x1877056127367808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790100607.835475:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04100da5-99d0-41db-b436-f542c1b00474+5:2419:x1877056127367808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 75us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100607.835483:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00080000:3.0:1790100607.835598:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100607.835678:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.835717:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.835808:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.835827:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127367680 00000100:00100000:2.0:1790100607.835831:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127367680 00000100:00100000:2.0:1790100607.835859:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127368320 00000100:00100000:2.0:1790100607.835872:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127368320 00000100:00100000:2.0:1790100607.835892:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1790100607.835899:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04100da5-99d0-41db-b436-f542c1b00474+5:2420:x1877056127367680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100607.836067:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1790100607.836076:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b6651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2419:x1877056127368320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100607.836121:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b6651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2419:x1877056127368320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.836128:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00080000:3.0:1790100607.836146:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100607.836149:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100607.836171:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.836213:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100607.836228:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127368192 00000100:00100000:3.0:1790100607.836233:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127368192 00000100:00100000:3.0:1790100607.836259:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790100607.836265:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2420:x1877056127368192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100607.836304:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2420:x1877056127368192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 38us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.836311:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00080000:3.0:1790100607.836326:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100607.836372:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127368064 00000100:00100000:3.0:1790100607.836375:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127368064 00000100:00100000:3.0:1790100607.836398:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127367936 00000100:00100000:3.0:1790100607.836401:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127367936 00000100:00100000:3.0:1790100607.836428:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1790100607.836434:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2419:x1877056127368064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100607.836465:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ceeef86-d61d-43f2-a898-ec1ecb26226c+5:2419:x1877056127368064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.836471:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1790100607.836503:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1790100607.836511:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+12:2420:x1877056127367936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790100607.836551:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ceeef86-d61d-43f2-a898-ec1ecb26226c+12:2420:x1877056127367936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 41us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100607.836557:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1790100607.837375:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04100da5-99d0-41db-b436-f542c1b00474+5:2420:x1877056127367680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 1474us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.837385:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1790100607.925209:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.926426:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127368576 00000100:00100000:2.0:1790100607.926440:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127368576 00000100:00100000:2.0:1790100607.926509:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1790100607.926521:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+21:15631:x1877056127368576:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790100607.926544:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100607.926564:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828837b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e64c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.926687:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f2298288382 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.926700:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f2298288382 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.926712:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f2298288382 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100607.926723:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790100607.926851:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46800/0xc87a4f229828837b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e64c expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.926880:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f2298288382 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e64c expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.926889:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100607.926893:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100607.926896:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47c00, rc 0) 00000100:00100000:2.0:1790100607.926972:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+23:15631:x1877056127368576:12345-192.168.203.13@tcp:101:cat.0 Request processed in 454us (1775us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790100607.926980:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1790100607.935824:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100607.935944:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127368832 00000100:00100000:1.0:1790100607.935954:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127368832 00000100:00100000:1.0:1790100607.936011:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790100607.936021:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+23:15631:x1877056127368832:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:1.0:1790100607.936310:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+24:15631:x1877056127368832:12345-192.168.203.13@tcp:35:cat.0 Request processed in 290us (494us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1790100607.936317:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1790100607.939196:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100607.939291:0:18335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127368960 00000100:00100000:2.0:1790100607.939300:0:18335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127368960 00000100:00100000:2.0:1790100607.939379:0:18335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1790100607.939389:0:18335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04100da5-99d0-41db-b436-f542c1b00474+24:2422:x1877056127368960:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100607.939403:0:18335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100607.939449:0:18335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f2298288382 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e64c expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100607.939466:0:18335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100607.939472:0:18335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100607.939525:0:18335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04100da5-99d0-41db-b436-f542c1b00474+23:2422:x1877056127368960:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 137us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100607.939533:0:18335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1790100608.007892:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100608.008512:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127369216 00000100:00100000:1.0:1790100608.008522:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127369216 00000100:00100000:1.0:1790100608.008580:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1790100608.008590:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b6650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+23:15637:x1877056127369216:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:1.0:1790100608.008624:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100608.008643:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0400/0xc87a4f2298288390 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e653 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.008746:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.008761:0:17182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.008769:0:17182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.009188:0:17182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.009287:0:17182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.009301:0:17182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 24 pid: 17181 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100608.009315:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17182:1877056141061120:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790100608.009420:0:17182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.009430:0:17182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 24 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100608.009451:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17182:1877056141061248:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790100608.009472:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194118cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100608.013289:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17182:1877056141061120:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100608.013302:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17182:1877056141061248:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100608.013328:0:17182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100608.014060:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.014146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.014399:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127369472 00000100:00100000:3.0:1790100608.014411:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127369472 00010000:00010000:3.0:1790100608.014445:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 25 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.014482:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127369344 00000100:00100000:3.0:1790100608.014485:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127369344 00010000:00010000:3.0:1790100608.014498:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 26 pid: 17181 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.014525:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1790100608.014533:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b6653480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+26:2421:x1877056127369472:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100608.014547:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100608.014553:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 26 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014564:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 26 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014583:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46e00/0xc87a4f2298288335 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e630 expref: 26 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014599:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:3.0:1790100608.014626:0:17165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014635:0:17165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014641:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100608.014684:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b6653480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+25:2421:x1877056127369472:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 151us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.014691:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1790100608.014706:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1790100608.014712:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926183d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+24:2421:x1877056127369344:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100608.014718:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100608.014723:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 24 pid: 17181 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014733:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 24 pid: 17181 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014745:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47a00/0xc87a4f229828834a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e637 expref: 24 pid: 17181 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014754:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:3.0:1790100608.014758:0:17165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014766:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014782:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.014811:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100608.014832:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926183d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+23:2421:x1877056127369344:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 119us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.014839:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00010000:00010000:2.0:1790100608.015236:0:17182:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.015245:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100608.015262:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790100608.015415:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0400/0xc87a4f2298288390 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e653 expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.015430:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1600/0xc87a4f2298288397 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e653 expref: 23 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.015450:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100608.015452:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790100608.015455:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261b66e1600, rc 0) 00000100:00100000:2.0:1790100608.015490:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b6650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+23:15637:x1877056127369216:12345-192.168.203.13@tcp:101:dd.0 Request processed in 6901us (7607us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790100608.015497:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1790100608.019920:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.020057:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127369600 00000100:00100000:3.0:1790100608.020067:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127369600 00000100:00100000:3.0:1790100608.020120:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1790100608.020129:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b6651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+23:15637:x1877056127369600:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:3.0:1790100608.020151:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100608.020168:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982883a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e65a expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.020198:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.020211:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.020221:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.020328:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f22982883a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 25 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.020374:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.020389:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:3.0:1790100608.020392:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790100608.020395:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7200, rc 0) 00000100:00100000:3.0:1790100608.020450:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b6651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+24:15637:x1877056127369600:12345-192.168.203.13@tcp:101:dd.0 Request processed in 322us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.020457:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1790100608.023757:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.024581:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127369856 00000100:00100000:2.0:1790100608.024591:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127369856 00000100:00100000:2.0:1790100608.024752:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1790100608.024763:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+24:15637:x1877056127369856:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:2.0:1790100608.025234:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.025251:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.025261:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100608.025303:0:17182:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1790100608.025324:0:17182:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005bd976d reply state 000000000d2ca28c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.025336:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.025370:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100608.025384:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790100608.025389:0:17182:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100608.025537:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+27:15637:x1877056127369856:12345-192.168.203.13@tcp:36:dd.0 Request processed in 774us (1787us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1790100608.025545:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000020:00080000:2.0:1790100608.025550:0:17182:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790100608.028198:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.028292:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127369984 00000100:00100000:2.0:1790100608.028301:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127369984 00000100:00100000:2.0:1790100608.028562:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1790100608.028572:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+27:15637:x1877056127369984:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1790100608.028594:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100608.028620:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883ba lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e661 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.028672:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883ba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e661 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.028686:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883ba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e661 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.028704:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100608.028707:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100608.028710:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47400, rc 0) 00000100:00100000:2.0:1790100608.028769:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+28:15637:x1877056127369984:12345-192.168.203.13@tcp:101:dd.0 Request processed in 198us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.028776:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1790100608.041129:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.041214:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127370240 00000100:00100000:3.0:1790100608.041223:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127370240 00000100:00100000:3.0:1790100608.041287:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1790100608.041297:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+28:15637:x1877056127370240:12345-192.168.203.13@tcp:103:dd.0 00010000:00010000:3.0:1790100608.041312:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100608.041373:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883ba lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e661 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.041395:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:3.0:1790100608.041400:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100608.041456:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+27:15637:x1877056127370240:12345-192.168.203.13@tcp:103:dd.0 Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.041463:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1790100608.043644:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.043885:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127370368 00000100:00100000:2.0:1790100608.043894:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127370368 00000100:00100000:2.0:1790100608.044004:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1790100608.044014:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+27:15637:x1877056127370368:12345-192.168.203.13@tcp:58:dd.0 00010000:00010000:2.0:1790100608.044114:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.044128:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.044137:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100608.044959:0:17182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100608.045211:0:17182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1790100608.045315:0:17182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1790100608.045498:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+27:15637:x1877056127370368:12345-192.168.203.13@tcp:58:dd.0 Request processed in 1482us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.045508:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1790100608.047412:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.047566:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127370496 00000100:00100000:2.0:1790100608.047576:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127370496 00000100:00100000:2.0:1790100608.047738:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1790100608.047748:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+27:15637:x1877056127370496:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1790100608.047767:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100608.047786:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e668 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.047845:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.047867:0:17181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e668 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.047904:0:17181:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.047918:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e668 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.047931:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100608.047934:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100608.047938:0:17181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e668 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.047946:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47800, rc 0) 00000100:00100000:2.0:1790100608.048004:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+28:15637:x1877056127370496:12345-192.168.203.13@tcp:101:dd.0 Request processed in 258us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.048011:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000040:00080000:2.0:1790100608.264524:0:17215:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790100608.264533:0:17215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100608.264556:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790100608.264564:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790100608.264692:0:17215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6650000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17215:1877056141061376:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790100608.264779:0:17215:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.277419:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.277618:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127370624 00000100:00100000:3.0:1790100608.277628:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127370624 00000100:00100000:3.0:1790100608.277694:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1790100608.277713:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+29:15638:x1877056127370624:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100608.277744:0:17182:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100608.277897:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+29:15638:x1877056127370624:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 193us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.277905:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1790100608.279440:0:17215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6650000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17215:1877056141061376:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790100608.280831:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.281427:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127370752 00000100:00100000:2.0:1790100608.281436:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127370752 00000100:00100000:2.0:1790100608.281491:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1790100608.281501:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+28:15638:x1877056127370752:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790100608.281606:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.281624:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.281634:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.281987:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.281997:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282004:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282027:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282034:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282040:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100608.282085:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790100608.282089:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790100608.282103:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282113:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282126:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282132:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282213:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100608.282218:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282226:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282238:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9261c1af1300) 00010000:00010000:2.0:1790100608.282241:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100608.282245:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282251:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46000/0xc87a4f22982883cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282264:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282270:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282275:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282280:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100608.282289:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282296:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282304:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9261a6366200) 00010000:00010000:2.0:1790100608.282306:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100608.282309:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282315:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f22982883d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282331:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282336:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282394:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.282399:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100608.282993:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.283001:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.283012:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:2.0:1790100608.283015:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100608.283038:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.283044:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f22982883dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100608.284481:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+28:15638:x1877056127370752:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 1637us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.284495:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1790100608.286418:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100608.286502:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127371008 00000100:00100000:1.0:1790100608.286522:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127371008 00000100:00100000:1.0:1790100608.286578:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1790100608.286596:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+28:15638:x1877056127371008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100608.286616:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100608.286636:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0600/0xc87a4f22982883e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e66f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.286867:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.286883:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.286895:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100608.286907:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790100608.286983:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.286991:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.286998:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.287017:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261b66e1a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:1.0:1790100608.287021:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.287040:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.287053:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:1.0:1790100608.287056:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100608.287061:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.287068:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1a00/0xc87a4f22982883eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.287935:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0600/0xc87a4f22982883e4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e66f expref: 30 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.287950:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9261c1af1300) 00010000:00010000:1.0:1790100608.287953:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100608.287958:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0600/0xc87a4f22982883e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e66f expref: 30 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.287968:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261b66e0600, rc 0) 00000100:00100000:1.0:1790100608.288019:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+29:15638:x1877056127371008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1433us (1619us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1790100608.289447:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1790100608.299301:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.299371:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127371136 00000100:00100000:2.0:1790100608.299382:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127371136 00000100:00100000:2.0:1790100608.299455:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1790100608.299536:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+29:15638:x1877056127371136:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790100608.299575:0:17181:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790100608.300037:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+29:15638:x1877056127371136:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 571us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.300046:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1790100608.304136:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100608.304698:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127371392 00000100:00100000:1.0:1790100608.304721:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127371392 00000100:00100000:1.0:1790100608.304782:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1790100608.304792:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+29:15638:x1877056127371392:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100608.304813:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100608.304834:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1000/0xc87a4f22982883f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e676 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790100608.305209:0:17180:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1790100608.305215:0:17180:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1790100608.305237:0:17180:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1790100608.305514:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1200/0xc87a4f2298288400 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.305528:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1200/0xc87a4f2298288400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.305539:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1200/0xc87a4f2298288400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.305594:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1000/0xc87a4f22982883f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e676 expref: 32 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.305611:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1200/0xc87a4f2298288400 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e676 expref: 31 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.305619:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261c1af0500) 00010000:00010000:1.0:1790100608.305622:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100608.305625:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261b66e1200, rc 0) 00000100:00100000:1.0:1790100608.305687:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+31:15638:x1877056127371392:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 897us (1559us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1790100608.305704:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1790100608.322750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.322917:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127371648 00000100:00100000:2.0:1790100608.322926:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127371648 00000100:00100000:2.0:1790100608.322986:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:2.0:1790100608.322997:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+31:15638:x1877056127371648:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100608.323066:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100608.323102:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e1200/0xc87a4f2298288400 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e676 expref: 31 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323120:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261c1af0500) 00010000:00010000:2.0:1790100608.323131:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100608.323525:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323553:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323564:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323633:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323641:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323648:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323693:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323712:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323718:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323724:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100608.323728:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323736:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323746:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:2.0:1790100608.323755:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100608.323760:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323766:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f229828840e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323776:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323781:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323787:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323792:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:2.0:1790100608.323794:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323801:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323808:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xefeda6e9 (ffff9261a6366200) 00010000:00010000:2.0:1790100608.323811:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100608.323814:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.323819:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f2298288415 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xefeda6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100608.324834:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+30:15638:x1877056127371648:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1831us (2085us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790100608.324868:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1790100608.331577:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.331665:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127371776 00000100:00100000:3.0:1790100608.331674:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127371776 00000100:00100000:3.0:1790100608.331830:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1790100608.331841:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+30:15638:x1877056127371776:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100608.331868:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100608.331889:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828841c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e67d expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.331922:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288423 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.331935:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288423 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.331945:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288423 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.332064:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f229828841c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e67d expref: 32 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.332093:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6400/0xc87a4f2298288423 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e67d expref: 31 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.332102:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:3.0:1790100608.332105:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790100608.332108:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6400, rc 0) 00000100:00100000:3.0:1790100608.332180:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+31:15638:x1877056127371776:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 340us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.332187:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1790100608.336950:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.337271:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127372032 00000100:00100000:2.0:1790100608.337281:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127372032 00000100:00100000:2.0:1790100608.337332:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1790100608.337356:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+31:15638:x1877056127372032:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100608.337443:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.337460:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.337473:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100608.337642:0:17181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1790100608.337652:0:17181:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459625312450ns, next at 460625310120ns, rc = 0 00000004:00010000:2.0:1790100608.337712:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae81a4f4 reply state 0000000086c03566 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.337725:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.337733:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:2.0:1790100608.337736:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790100608.337739:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100608.338004:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+33:15638:x1877056127372032:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 662us (1061us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790100608.338013:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1790100608.340783:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.341295:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127372160 00000100:00100000:2.0:1790100608.341316:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127372160 00000100:00100000:2.0:1790100608.341398:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1790100608.341419:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+33:15638:x1877056127372160:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100608.341442:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100608.341460:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e684 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.341512:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 34 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.341526:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 34 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.341545:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:2.0:1790100608.341548:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100608.341551:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926083e47400, rc 0) 00000100:00100000:2.0:1790100608.341607:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+34:15638:x1877056127372160:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 191us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.341613:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1790100608.354539:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100608.354744:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127372288 00000100:00100000:0.0:1790100608.354754:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127372288 00000100:00100000:0.0:1790100608.354820:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1790100608.354831:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2421:x1877056127372288:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790100608.355105:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04100da5-99d0-41db-b436-f542c1b00474+6:2421:x1877056127372288:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 276us (575us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790100608.355112:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790100608.358086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100608.358279:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127372544 00000100:00100000:0.0:1790100608.358290:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127372544 00000100:00100000:0.0:1790100608.358389:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790100608.358401:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+34:15638:x1877056127372544:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790100608.358643:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+35:15638:x1877056127372544:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 244us (574us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1790100608.358664:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790100608.362582:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.362733:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127372800 00000100:00100000:3.0:1790100608.362743:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127372800 00000100:00100000:3.0:1790100608.362811:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790100608.362822:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+35:15638:x1877056127372800:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790100608.362942:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+35:15638:x1877056127372800:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 122us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.362949:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1790100608.373951:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.374246:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127372928 00000100:00100000:3.0:1790100608.374256:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127372928 00000100:00100000:3.0:1790100608.374318:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1790100608.374329:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+35:15638:x1877056127372928:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100608.374395:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100608.374417:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288438 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e68b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.374495:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828843f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.374524:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828843f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.374537:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828843f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100608.374604:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790100608.374624:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828843f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.374652:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7e00/0xc87a4f2298288438 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e68b expref: 37 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.374671:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828843f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e68b expref: 36 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.374681:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:3.0:1790100608.374684:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790100608.374688:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b6a00, rc 0) 00000100:00100000:3.0:1790100608.375600:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+36:15638:x1877056127372928:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1008us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.375612:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1790100608.382807:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.382934:0:19675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127373056 00000100:00100000:3.0:1790100608.382944:0:19675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127373056 00000100:00100000:3.0:1790100608.382999:0:19675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1790100608.383009:0:19675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04100da5-99d0-41db-b436-f542c1b00474+6:2420:x1877056127373056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100608.383027:0:19675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100608.383047:0:19675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e692 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100608.383071:0:19675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c47f, blocks: 0x0 00010000:00010000:3.0:1790100608.383103:0:19675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1790100608.383122:0:19675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100608.383131:0:19675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 7 pid: 19675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.383165:0:19675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 7 pid: 19675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.383179:0:19675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9261a63b7e00, rc 0) 00000100:00100000:3.0:1790100608.383240:0:19675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04100da5-99d0-41db-b436-f542c1b00474+7:2420:x1877056127373056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 232us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.383247:0:19675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790100608.398944:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.399694:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127373312 00000100:00100000:2.0:1790100608.399706:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127373312 00000100:00100000:2.0:1790100608.399765:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1790100608.399774:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+36:15638:x1877056127373312:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100608.399900:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04100da5-99d0-41db-b436-f542c1b00474+36:15638:x1877056127373312:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 126us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.399907:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1790100608.405221:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.405381:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127373440 00000100:00100000:3.0:1790100608.405392:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127373440 00000100:00100000:3.0:1790100608.405465:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1790100608.405476:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+36:15638:x1877056127373440:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790100608.411104:0:17160:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1790100608.411134:0:17160:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1790100608.411185:0:17160:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1790100608.411677:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.411690:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.411698:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.411704:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8f400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:3.0:1790100608.411709:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.411717:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.411741:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:3.0:1790100608.411744:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790100608.411750:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.411756:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f22982882d3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.411899:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+19:15638:x1877056127373440:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 6421us (6684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.411909:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1790100608.411991:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260831bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141061504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790100608.412055:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.412214:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141061504 00000100:00100000:3.0:1790100608.412222:0:18688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141061504 00000100:00100000:3.0:1790100608.412267:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790100608.412276:0:18688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b6650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141061504:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1790100608.413244:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1790100608.413685:0:18688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790100608.413689:0:18688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1790100608.413691:0:18688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790100608.413693:0:18688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790100607 -> 1790100607 00002000:00010000:2.0:1790100608.413695:0:18688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790100608.413764:0:18688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b6650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1877056141061504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1486us (1706us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790100608.413772:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1790100608.413880:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9260831bca80/2, rc 0, transno 8589934596 00000100:00100000:3.0:1790100608.413888:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260831bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141061504:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1790100608.416977:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.416995:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417003:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417009:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8e400 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.417014:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417022:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417038:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9261c1af0a00) 00010000:00010000:0.0:1790100608.417042:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100608.417047:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417054:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8e400/0xc87a4f229828827f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417079:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417086:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417105:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417109:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926184b8ee00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.417112:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417119:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417127:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9261c1af0e00) 00010000:00010000:0.0:1790100608.417129:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100608.417132:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417138:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8ee00/0xc87a4f2298288286 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417153:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417159:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417165:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417170:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.417172:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417189:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417198:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9261a6366900) 00010000:00010000:0.0:1790100608.417200:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100608.417203:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417209:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46c00/0xc87a4f229828832e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417226:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417232:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417238:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417242:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e47c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.417245:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417251:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417257:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:0.0:1790100608.417259:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100608.417262:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417274:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47c00/0xc87a4f22982883b3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417285:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417291:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417297:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417301:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46a00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.417305:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417311:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417318:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:0.0:1790100608.417320:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790100608.417324:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.417330:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46a00/0xc87a4f229828842a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100608.420887:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.421019:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127373568 00000100:00100000:3.0:1790100608.421029:0:18687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127373568 00000100:00100000:3.0:1790100608.421090:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1790100608.421100:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04100da5-99d0-41db-b436-f542c1b00474+7:2421:x1877056127373568:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790100608.421228:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04100da5-99d0-41db-b436-f542c1b00474+7:2421:x1877056127373568:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 129us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.421236:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1790100608.425694:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.425781:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127373824 00000100:00100000:3.0:1790100608.425791:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127373824 00000100:00100000:3.0:1790100608.425881:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:3.0:1790100608.425890:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+15:15638:x1877056127373824:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790100608.425942:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100608.425970:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b6a00/0xc87a4f229828843f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e68b expref: 15 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.425989:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:3.0:1790100608.425994:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100608.426025:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828844d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.426038:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828844d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.426047:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828844d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100608.426332:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d0742b1 reply state 000000004d343db8 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828844d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.426465:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926184b8f400/0xc87a4f229828844d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.426471:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:3.0:1790100608.426473:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790100608.426476:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100608.426588:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04100da5-99d0-41db-b436-f542c1b00474+16:15638:x1877056127373824:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 697us (901us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1790100608.426596:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1790100608.429710:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.430376:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127373952 00000100:00100000:3.0:1790100608.430408:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127373952 00000100:00100000:3.0:1790100608.430458:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790100608.430468:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04100da5-99d0-41db-b436-f542c1b00474+7:15638:x1877056127373952:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100608.430485:0:19357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100608.430503:0:19357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e699 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.430544:0:19357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 8 pid: 19675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.430554:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100608.430558:0:19357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100608.430564:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 8 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.430596:0:19357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 8 pid: 19675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.430609:0:19357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 8 pid: 19675 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.430623:0:19357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19357:1877056141061632:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100608.430701:0:19357:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992780 going to sleep for 11 seconds 00000100:00100000:3.0:1790100608.433803:0:19357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19357:1877056141061632:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100608.433835:0:19357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 8 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.433879:0:19357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565c200, rc 0) 00000100:00100000:3.0:1790100608.433937:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260831bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04100da5-99d0-41db-b436-f542c1b00474+8:15638:x1877056127373952:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 3470us (4235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.433946:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1790100608.434075:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.434707:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127374080 00000100:00100000:3.0:1790100608.434714:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127374080 00010000:00010000:3.0:1790100608.434742:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 8 pid: 19675 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.434775:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1790100608.434783:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:04100da5-99d0-41db-b436-f542c1b00474+8:2421:x1877056127374080:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100608.434802:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100608.434821:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 8 pid: 19675 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.434833:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 8 pid: 19675 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.434854:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea1fd7e/0xc87a4f2298288446 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e692 expref: 8 pid: 19675 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.434879:0:17166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100608.434883:0:17166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100608.434889:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 7 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.434907:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 7 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.434939:0:17166:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 7 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.434952:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17166:1877056141061760:192.168.203.13@tcp:105: 00000100:00100000:3.0:1790100608.435087:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.438239:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790100608.438551:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127374208 00000100:00100000:1.0:1790100608.438561:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127374208 00000100:00100000:1.0:1790100608.438631:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1790100608.438642:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92618683ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04100da5-99d0-41db-b436-f542c1b00474+8:2421:x1877056127374208:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790100608.438805:0:18686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790100608.438810:0:18686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1790100607 00002000:00010000:1.0:1790100608.438812:0:18686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1790100606 00002000:00010000:1.0:1790100608.438814:0:18686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790100607 -> 1790100607 00002000:00010000:1.0:1790100608.438817:0:18686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790100608.438827:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17166:1877056141061760:192.168.203.13@tcp:105: 00010000:00010000:3.0:1790100608.438848:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100608.438876:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04100da5-99d0-41db-b436-f542c1b00474+9:2421:x1877056127374208:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 234us (645us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790100608.438886:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92618683c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:04100da5-99d0-41db-b436-f542c1b00474+9:2421:x1877056127374080:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4101us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100608.438887:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1790100608.438901:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790100608.442221:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.447269:0:19675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127374336 00000100:00100000:2.0:1790100608.447284:0:19675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127374336 00000100:00100000:2.0:1790100608.447371:0:19675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1790100608.447381:0:19675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926193d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04100da5-99d0-41db-b436-f542c1b00474+8:2422:x1877056127374336:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790100608.447424:0:19675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.447445:0:19675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 8 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.447454:0:19675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100608.447458:0:19675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100608.447463:0:19675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.447518:0:19675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 8 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.447533:0:19675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 8 pid: 19357 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100608.447547:0:19675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6651180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19675:1877056141061888:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790100608.447884:0:19675:0:(client.c:2716:ptlrpc_set_wait()) set ffff926083ce5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100608.451048:0:19675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6651180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19675:1877056141061888:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790100608.451077:0:19675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100608.453566:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790100608.454069:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127374464 00000100:00100000:2.0:1790100608.454079:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127374464 00010000:00010000:2.0:1790100608.454129:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 9 pid: 19357 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100608.454185:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1790100608.454195:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+9:2422:x1877056127374464:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100608.454210:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100608.454230:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 9 pid: 19357 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.454263:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 9 pid: 19357 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.454289:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b354ce7/0xc87a4f2298288454 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e699 expref: 9 pid: 19357 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.454305:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100608.454311:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100608.454316:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.454325:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100608.454403:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100608.454461:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+8:2422:x1877056127374464:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 267us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.454468:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:1.0:1790100608.455051:0:19675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.455078:0:19675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.455102:0:19675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.455111:0:19675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.455119:0:19675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.455127:0:19675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46000 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100608.455132:0:19675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.455141:0:19675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.455156:0:19675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.455164:0:19675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033a8b5a7/0xc87a4f229828845b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100608.455250:0:19675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926193d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:04100da5-99d0-41db-b436-f542c1b00474+7:2422:x1877056127374336:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 7868us (13037us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100608.455258:0:19675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1790100608.480170:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.480258:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127374720 00000100:00100000:3.0:1790100608.480268:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127374720 00000100:00100000:3.0:1790100608.480330:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1790100608.480378:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+16:15638:x1877056127374720:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790100608.480468:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.480486:0:17180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 16 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.480497:0:17180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.480557:0:17180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 16 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.480573:0:17180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 16 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.480587:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141062016:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790100608.480658:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff926084992780 going to sleep for 11 seconds 00000100:00100000:3.0:1790100608.489519:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a52680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141062016:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100608.489549:0:17180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100608.490867:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100608.490931:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127374848 00000100:00100000:0.0:1790100608.490940:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127374848 00010000:00010000:0.0:1790100608.490988:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 17 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100608.491029:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790100608.491038:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04100da5-99d0-41db-b436-f542c1b00474+17:2422:x1877056127374848:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100608.491054:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100608.491062:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 17 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.491074:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 17 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.491094:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261a63b7200/0xc87a4f22982883ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e65a expref: 17 pid: 17180 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.491111:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:0.0:1790100608.491117:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e668 expref: 16 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.491128:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.491136:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.491143:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.491182:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100608.491246:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04100da5-99d0-41db-b436-f542c1b00474+16:2422:x1877056127374848:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 208us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.491254:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00010000:00010000:1.0:1790100608.491332:0:17180:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.491371:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.491573:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.491586:0:17180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 16 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.491595:0:17180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.491624:0:17180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 16 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.491639:0:17180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 16 pid: 17182 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100608.491652:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c54000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141062144:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790100608.491710:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261b6800480 going to sleep for 11 seconds 00000100:00100000:3.0:1790100608.498151:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c54000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141062144:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790100608.498181:0:17180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100608.502709:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100608.502945:0:18335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127374976 00000100:00100000:0.0:1790100608.502956:0:18335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127374976 00010000:00010000:0.0:1790100608.503002:0:18335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 17 pid: 17182 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100608.507430:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1790100608.510968:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b6651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+17:2421:x1877056127374976:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100608.510994:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100608.511005:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 17 pid: 17182 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.511023:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 17 pid: 17182 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.511055:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47400/0xc87a4f2298288431 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e684 expref: 17 pid: 17182 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.511086:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:3.0:1790100608.511091:0:17165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.511100:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.511107:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.511150:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100608.511219:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b6651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04100da5-99d0-41db-b436-f542c1b00474+16:2421:x1877056127374976:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 3776us (8519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.511228:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00010000:00010000:0.0:1790100608.511387:0:17180:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.511395:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100608.511503:0:17180:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1790100608.511608:0:17180:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1790100608.511641:0:17180:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1790100608.511709:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92618683ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17180:1877056141062272:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790100608.511762:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100608.511879:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194118e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100608.512444:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141062272 00000100:00100000:3.0:1790100608.512452:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141062272 00000100:00100000:3.0:1790100608.512546:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790100608.512555:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17180:x1877056141062272:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790100608.512633:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17180:x1877056141062272:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.512639:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790100608.513260:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92618683ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17180:1877056141062272:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790100608.513458:0:17180:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1790100608.513520:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17180:1877056141062400:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790100608.513559:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100608.513640:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff926194118c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100608.523916:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141062400 00000100:00100000:2.0:1790100608.523930:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141062400 00000100:00100000:2.0:1790100608.524182:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790100608.524192:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1877056141062400:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790100608.524912:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17180:x1877056141062400:12345-0@lo:1000:mdt00_000.0 Request processed in 719us (11350us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1790100608.524934:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790100608.525616:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17180:1877056141062400:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790100608.525666:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525688:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525695:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525703:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9261b66e0200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.525707:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525715:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525730:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:0.0:1790100608.525746:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790100608.525751:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525758:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9261b66e0200/0xc87a4f2298288469 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525871:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525878:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525883:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525888:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926083e46600 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.525897:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525903:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525913:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:0.0:1790100608.525916:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790100608.525922:0:17180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e668 expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525933:0:17180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e668 expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.525941:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e668 expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.526935:0:17180:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff926083e47800/0xc87a4f22982883c8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e668 expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100608.527115:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083cd1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141062528:192.168.203.13@tcp:105: 00000100:00100000:0.0:1790100608.527261:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff9261941186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.533136:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083cd1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17180:1877056141062528:192.168.203.13@tcp:105: 00010000:00010000:0.0:1790100608.533168:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533178:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926083e46600/0xc87a4f22982883c1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533240:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533253:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533264:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533274:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533280:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533286:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533292:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686c00 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.533296:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533303:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533314:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:0.0:1790100608.533317:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100608.533322:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533328:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288470 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533384:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533390:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533395:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533400:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92619565d200 already unused, calling callback (ffffffffc19dd4f0) 00010000:00010000:0.0:1790100608.533404:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533410:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533419:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:0.0:1790100608.533421:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790100608.533424:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.533429:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565d200/0xc87a4f2298288462 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100608.537275:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100608.537556:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127375104 00000100:00100000:0.0:1790100608.537566:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127375104 00000100:00100000:0.0:1790100608.537620:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790100608.537630:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a648d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+20:15637:x1877056127375104:12345-192.168.203.13@tcp:49:dd.0 00000100:00100000:0.0:1790100608.537752:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a648d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+20:15637:x1877056127375104:12345-192.168.203.13@tcp:49:dd.0 Request processed in 123us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.537775:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790100608.543088:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.543236:0:17181:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790100608.543247:0:17181:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790100608.543882:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127375232 00000100:00100000:2.0:1790100608.543907:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127375232 00000100:00100000:3.0:1790100608.544161:0:20322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:3.0:1790100608.544173:0:20322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b6652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04100da5-99d0-41db-b436-f542c1b00474+20:15637:x1877056127375232:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:3.0:1790100608.544192:0:20322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100608.544211:0:20322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c400/0xc87a4f2298288477 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5e3cdbbfe230e6a0 expref: -99 pid: 20322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.544250:0:20322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c200/0xc87a4f229828847e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.544264:0:20322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c200/0xc87a4f229828847e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.544274:0:20322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c200/0xc87a4f229828847e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.544578:0:20322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c400/0xc87a4f2298288477 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e6a0 expref: 22 pid: 20322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.544597:0:20322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92619565c200/0xc87a4f229828847e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5e3cdbbfe230e6a0 expref: 21 pid: 20322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.544606:0:20322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9261a6366500) 00010000:00010000:3.0:1790100608.544608:0:20322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790100608.544612:0:20322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92619565c200, rc 0) 00000100:00100000:3.0:1790100608.544662:0:20322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b6652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04100da5-99d0-41db-b436-f542c1b00474+21:15637:x1877056127375232:12345-192.168.203.13@tcp:101:dd.0 Request processed in 491us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.544669:0:20322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1790100608.547931:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04100da5-99d0-41db-b436-f542c1b00474+20:15638:x1877056127374720:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 67583us (67761us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1790100608.547944:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000020:00080000:1.0:1790100608.547951:0:17180:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790100608.548323:0:17215:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790100608.548328:0:17215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100608.548495:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790100608.548502:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790100608.557454:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100608.557648:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127375488 00000100:00100000:0.0:1790100608.557659:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127375488 00000100:00100000:0.0:1790100608.557712:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1790100608.557721:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261b6651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+20:15638:x1877056127375488:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790100608.558152:0:17184:0:(mdd_object.c:4178:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790100608.558183:0:17184:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1790100608.558216:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.558233:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.558245:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.558253:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.558260:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.558266:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.558324:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790100608.558452:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261b6651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04100da5-99d0-41db-b436-f542c1b00474+22:15638:x1877056127375488:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 731us (1008us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1790100608.558460:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000020:00080000:0.0:1790100608.558472:0:17184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790100608.563015:0:19677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100608.563030:0:19677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.563042:0:19677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191686c00 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:3.0:1790100608.563046:0:19677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.563074:0:19677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.563093:0:19677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9261900b4b00) 00010000:00010000:3.0:1790100608.563096:0:19677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790100608.563101:0:19677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.563108:0:19677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926191686c00/0xc87a4f2298288485 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.565686:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100608.565693:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100608.565696:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100608.712802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790100608.712847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790100608.713742:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127375616 00000100:00100000:0.0:1790100608.713753:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127375616 00000100:00100000:0.0:1790100608.713819:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056127375744 00000100:00100000:0.0:1790100608.713823:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056127375744 00000100:00100000:0.0:1790100608.713846:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790100608.713866:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04100da5-99d0-41db-b436-f542c1b00474+8:2419:x1877056127375616:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:0.0:1790100608.713913:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6ab2c47f, atime: 0x6ab2c47e, ctime: 0x6ab2c47f, blocks: 0x0 00010000:00010000:0.0:1790100608.713923:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.713940:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790100608.713944:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100608.713951:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.713967:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.778687:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790100608.817049:0:19501:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1790100608.817064:0:19501:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1790100608.817303:0:18692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1790100608.817307:0:18692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1790100607 -> 1790100608 00002000:00010000:0.0:1790100608.817310:0:18692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790100607 -> 1790100608 00002000:00010000:0.0:1790100608.817312:0:18692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1790100608.817331:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.817390:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.817398:0:18692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.817404:0:18692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687400 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:0.0:1790100608.817409:0:18692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.817418:0:18692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.817437:0:18692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.817445:0:18692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c18af9/0xc87a4f229828848c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100608.817768:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04100da5-99d0-41db-b436-f542c1b00474+6:2419:x1877056127375616:12345-192.168.203.13@tcp:4:dd.0 Request processed in 103908us (104981us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790100608.817777:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790100608.821813:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1790100608.821839:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2419:x1877056127375744:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:0.0:1790100608.821901:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6ab2c480, atime: 0x6ab2c47e, ctime: 0x6ab2c480, blocks: 0x2000 00010000:00010000:0.0:1790100608.821924:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.821940:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790100608.821945:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100608.821951:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.821965:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100608.883547:0:19501:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1790100608.891692:0:18692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1790100608.891701:0:18692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1790100608.891718:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.891731:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.891740:0:18692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.891747:0:18692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926191687600 already unused, calling callback (ffffffffc0da1900) 00010000:00010000:1.0:1790100608.891752:0:18692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.891760:0:18692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.891778:0:18692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.891810:0:18692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d23ae309/0xc87a4f2298288493 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100608.892826:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04100da5-99d0-41db-b436-f542c1b00474+5:2419:x1877056127375744:12345-192.168.203.13@tcp:4:dd.0 Request processed in 70994us (179972us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790100608.892849:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1790100609.480866:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100609.480890:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141062656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790100609.480961:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100609.481419:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141062656 00000100:00100000:1.0:1790100609.481429:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141062656 00000100:00100000:1.0:1790100609.481488:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790100609.481497:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141062656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790100609.481539:0:17921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790100609.481709:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100609.481719:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926084a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141062784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790100609.481748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100609.481827:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141062784 00000100:00100000:2.0:1790100609.481832:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141062784 00000100:00100000:2.0:1790100609.481897:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790100609.481904:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926084a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141062784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790100609.481923:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790100609.481964:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141062784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100609.481970:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790100609.482059:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926084a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141062784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790100609.482169:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926084a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141062656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 672us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100609.482176:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790100609.482292:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141062656:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790100609.801403:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100609.994593:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141062912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790100609.994675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100609.994770:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141062912 00000100:00100000:2.0:1790100609.994779:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141062912 00000100:00100000:2.0:1790100609.994864:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100609.994873:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141062912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790100609.994916:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790100609.994966:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141062912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100609.994974:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100609.995038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141062912:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790100609.995194:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1790100610.377049:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1790100610.418615:0:20359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1790100610.506408:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141063040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790100610.506620:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff926083c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141063168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100610.506990:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141063424:0@lo:400:kworker.0 00000100:00100000:1.0:1790100610.508568:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100610.508617:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141063680:0@lo:400:kworker.0 00000100:00100000:1.0:1790100610.508649:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100610.508667:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056141064192:0@lo:400:kworker.0 00000100:00100000:1.0:1790100610.508689:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100610.508705:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141064704:0@lo:400:kworker.0 00000100:00100000:1.0:1790100610.508723:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100610.513077:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100610.513147:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141063552:0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.514980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100610.515025:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141064064:0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515050:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100610.515071:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056141064576:0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515093:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100610.515176:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141064192 00000100:00100000:0.0:1790100610.515184:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141064192 00000100:00100000:0.0:1790100610.515226:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141064704 00000100:00100000:0.0:1790100610.515237:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141064704 00000100:00100000:0.0:1790100610.515260:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141064576 00000100:00100000:0.0:1790100610.515262:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141064576 00000100:00100000:0.0:1790100610.515275:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790100610.515283:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056141064192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515331:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1877056141064192:12345-0@lo:400:kworker.0 Request processed in 49us (6641us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.515354:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790100610.515372:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100610.515378:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9261a636b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056141064704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515407:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9261a636b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1877056141064704:12345-0@lo:400:kworker.0 Request processed in 31us (6683us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.515412:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100610.515423:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790100610.515428:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056141064576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515470:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1877056141064576:12345-0@lo:400:kworker.0 Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.515475:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790100610.515493:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141063680 00000100:00100000:0.0:1790100610.515496:0:18687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141063680 00000100:00100000:0.0:1790100610.515522:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141063552 00000100:00100000:0.0:1790100610.515525:0:18687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141063552 00000100:00100000:0.0:1790100610.515543:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141064064 00000100:00100000:0.0:1790100610.515545:0:18687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141064064 00000100:00100000:0.0:1790100610.515560:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100610.515565:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141063680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515596:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141063680:12345-0@lo:400:kworker.0 Request processed in 30us (6946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.515610:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100610.515622:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790100610.515627:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141063552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515654:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1877056141063552:12345-0@lo:400:kworker.0 Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.515659:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790100610.515670:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100610.515676:0:18687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141064064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515699:0:18687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141064064:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.515704:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1790100610.515718:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100610.515722:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100610.515724:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100610.515726:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100610.515770:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1877056141063552:0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515781:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141064064:0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.515789:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1877056141064576:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.516221:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141063168 00000100:00100000:2.0:1790100610.516226:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141063168 00000100:00100000:2.0:1790100610.516265:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141063040 00000100:00100000:2.0:1790100610.516269:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141063040 00000100:00100000:2.0:1790100610.516281:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100610.516287:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141063168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100610.516302:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790100610.516358:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1877056141063168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (7794us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100610.516365:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100610.516379:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100610.516385:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926083cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141063040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790100610.516394:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1790100610.516423:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926083cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1877056141063040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100610.516428:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100610.516563:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100610.516591:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141063424 00000100:00100000:2.0:1790100610.516595:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141063424 00000100:00100000:2.0:1790100610.516618:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790100610.516625:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260852c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141063424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.516655:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260852c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141063424:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100610.516669:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790100610.516702:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141063424:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.516712:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141063936:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.516738:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100610.516759:0:17921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141063936 00000100:00100000:2.0:1790100610.516763:0:17921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141063936 00000100:00100000:2.0:1790100610.516783:0:17921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790100610.516789:0:17921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260852c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141063936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.516833:0:17921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260852c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877056141063936:12345-0@lo:400:kworker.0 Request processed in 44us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100610.516838:0:17921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790100610.516871:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1877056141063936:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.516878:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056141064448:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.516902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100610.516926:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1790100610.517264:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141064448 00000100:00100000:0.0:1790100610.517269:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141064448 00000100:00100000:0.0:1790100610.517311:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790100610.517317:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260852c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056141064448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.517371:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260852c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877056141064448:12345-0@lo:400:kworker.0 Request processed in 55us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.517378:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1790100610.517401:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790100610.517431:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1877056141063040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790100610.517895:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141063296:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.517944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100610.517969:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141063296 00000100:00100000:2.0:1790100610.517973:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141063296 00000100:00100000:2.0:1790100610.518000:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790100610.518007:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926187c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:3642:x1877056141063296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.518037:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926187c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:687676b7-da9e-40a3-8051-3299bac6cf99+24:3642:x1877056141063296:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100610.518042:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790100610.518094:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:687676b7-da9e-40a3-8051-3299bac6cf99:3642:1877056141063296:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.518102:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056141063808:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.518127:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100610.518148:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9261b6653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056141064320:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.518300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100610.518320:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9260852c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141064832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100610.518358:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100610.518377:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141064832 00000100:00100000:2.0:1790100610.518381:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141064832 00000100:00100000:2.0:1790100610.518403:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100610.518409:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260852c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141064832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100610.518422:0:18690:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1790100610.518449:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260852c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877056141064832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.518553:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141063808 00000100:00100000:0.0:1790100610.518557:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141063808 00000100:00100000:0.0:1790100610.518580:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056141064320 00000100:00100000:0.0:1790100610.518583:0:17182:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056141064320 00000100:00100000:0.0:1790100610.518602:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790100610.518608:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260852c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056141063808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.518641:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260852c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877056141063808:12345-0@lo:400:kworker.0 Request processed in 33us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.518647:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790100610.518660:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790100610.518666:0:17182:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9260852c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056141064320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100610.518690:0:17182:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9260852c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877056141064320:12345-0@lo:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100610.518695:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1790100610.518711:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100610.518749:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100610.518776:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1790100610.518781:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9260831bca80, transno 8589934596 00000004:00080000:2.0:1790100610.518797:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1790100610.518899:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9260852c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1877056141064832:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790100610.518915:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b6651f80 x1877056141064448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100610.518925:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1877056141064448:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.519010:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877056141063808:0@lo:400:kworker.0 00000100:00100000:2.0:1790100610.519020:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1877056141064320:0@lo:400:kworker.0 00010000:00080000:1.0:1790100610.522071:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9261b6653480 x1877056141064704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100610.522100:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1877056141064704:0@lo:400:kworker.0 00000100:00100000:1.0:1790100610.522127:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff926083c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141063168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100610.522443:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1877056141063680:0@lo:400:kworker.0 00000100:00100000:1.0:1790100610.522468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9261b6651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1877056141064192:0@lo:400:kworker.0 00010000:00010000:0.0:1790100610.824511:0:19677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100611.861196:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 40568 lines, 40568 kept, 0 dropped, 0 bad.